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ABSTRACT . ; . 

Central to this project/, "hi^^j^ designed a staff- 
development prototype, was the need f or' Pj^^^j-^^^g and inservice- 
staff development designed to improve skills required -for succes:^fttl 
performance of guidance personnel. Tier pro j^^^ conducted durinjg'" " 

an 18-month period in five gj^ses. Phase .1 involved integrating. 
existing Califprnia and American Institutes Research (ilR) models 
for career guidance program development*. P^^se 2 entailed the 
national search for stdff development materi^^g ^^^^ ^-^^ de^velopment 
of a system of modules and workshops to "tea^jj^ ^^^^ basic skills' 
needed to develop program:^ coiisistent with integrated .mbdel, 

produced in Phase 1. Phase 3 was a pilot te^^ pf 'this prototype- staff 
development program with selected school P^t^o^^jgl^ In-ptase 4, the 
system was field tested in both preservice j^^^^ inservice §et'tings. In 
phase -5, information about the program and t^smts of the field 
testing were disseminated. Results of the Project were mixed, with 
competencies increasing to a degree, axi^ ^^^itudes toward. the 
experience a mixture of positive and negativ^^ noted that a • 

niimber of improvements and refinement's be ■ made in both tJie 

materials and their delivery to strengthen tiiieij.^ impact on th,e^career 
counseling area of education. This report in^^^^^^ ^ Qomplete 
description of the project methods (activiti^^- accomplishments, 
problems, and staff utilization), results* "conclusions- and 

recommendations. ('Author/TA) ' 7 
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Other Project Products: 

Twelve modules., bound in five voluriles: 

• Orientation 
Phase 1 (Planning) 

^ ~ • Phase 2 (Structurfng) o 

• Phase .3 (Implementing). 
^ ' • Phase^ 4 (Evaluating) 

Twelve Coordinator's Guides, bound'and labeled identieally to^ the 

above; five volumes. 
Five introductory tape-slide presentation-s , paralleling the five' volumes 
A Catalog of Competency^^sed Education Programs fflr Guidance and 

Counseling Personnel .\ 




ABSTRACT : ' / 

A VALIDATED PROGRAM DEVELOPMENT MODEL AND STAFF DEVELOPMENT PROTOTYPE FOR 
COMPREHENSIVE. CAREER GUIDANCE, COUNSELING, PLACEM^T AND FOLLQWUP 

Pvoblemr^ on M^hir^J\ P7\)Jcct Fnauced - ^^.-^-v ' 

Comprehensive systems of guidance, counseling, placement, and followup 
services for students and adults need to be improved. California studies and 
nationwide surveys have cleaMy determined and documented this fact. A leading 
suggestion coming out of both state and national studies for directions in 
jWhiCh 'to move to best achieve such improvements is- through preservice and in- 

• se^rviqe' staff development desi gned to improve skills required for successful 
performance of guidance personnel. This 18-month project developed and field 
tested a "prototype" of <:ompetency-based education for those working in 

• guidance. - This prototype consists of a series. of 12 modules and' accompanyi ng . 
Coordinator's Guides which' focus .on program..^evelopment skills. These skills 
fall into these four groups or phases baserf^son a program development model 
refined through this project: 

• .Planning-co'ijlducting desired outcomes assessments and current status' 
^ ' -assessments, setting program goals 

•'Structuring-writing student performance objectives, selecting 
effective program strategies * ^ 

• Implementing-managing programs^ develop n^. staff, monitoring 
activities , ' . . ' 

• -Evaluating-cqnducting summative evaluation, communicating results 

! A second problem that exists today is the proliferation of materials 
related to skill-oriented guidance staff development, and the lack of coor- 
dination, or, ev-en awareness, among various efforts. What was needed was a 
survev of all exist^ing materials, and the production of a catalog which 
.summarr^d the various rfiaterials, such that an individual could efficiently ^ 
determin\ just what was available. Thus an accOmpanyiag project effort was 
a nationaX search formal T competency-based education protframs designed for 
guidance a\id counseling personnel. Jhe results of this search were converted 
to a catalog describing such programs. " ' ' 



The project was conducted between 1 July 1974 and 3^1 December ' 1 975. ^ 
Phase I involved integrating existing California and AIR models for career ^ 
guidance program development. Phase II entailed the national search far 
staff development materialst and the development of a system of modules and 
workshops to teach some of the basic s-kills needed to develop programs con- 
sistent with the integrated model produced in' Phase I. Phase III was ^ pilot 
test of thos^^"prototype" staff development program with selected school per- 
'sonrfel from the San Francisco Bay Area. Feedback received from this pilot 
test .defined revisions needed in the materials and the staff development pro- ' 
cedures. .Once these revisions were completed, in Phase IV the system underwent 
B full-scale field test^in two school districts in California, in the late 
summer and early fall of 1975. A third field test took place at a pHeservice 
setting, in a class made up of guidance and counseling majors at the University 
of Missouri, and taught by a member of the project's National Advisory Panel. 



Data were collected with a variety of tochniquos includirKj: pro-post self- 
assessments of competencies described in module, objecti ves , ratings ty moduVe 
Coordinators of participants' achievenient of objectives, a reaction 'form cojii- 
pleted by the participants regarding tht^ usefulness of each module, a two- 
month followup interview sampling incidents of workshop imp,act, a two-nionth 
followup test of knowledge; and oral debriqfings at the end' of each staff 
development session. ^. 

• Finally, In Phase y, information about' the program and results of the 
field test were disseminated through an Ameri/:an -Col lege .Personnel Association 
workshop which used some of the materials developed, through a monograph . 
published by Impact of ERIC-CAPS, University of Michigan,- and through a 
chapter in Niew H oriz ons in Counseling Psychol o gys 'a new. resour^ce text in 
counseling psychology. In addition, 100 sets of the modules and 200 cop^ies 
of the catalog were made avai lable .for sale through the Publ i cations Of f ice 
of the American Institutes for Research.."- . • 

Certain concepts are central to the project's effort. One is that of , ^ 
career development. \ Rather than the definition of career si^iiply as vocation, 
•the .attempt vyas to view it more broadly as a life-development process which ' 
involves all the important- elements in an individual's growth toward what 
s/he would like to be. A second is that-of fcomp^tency-based . The staff 
, development |brogram attempted to go beyond the cognitive or attitudinal level 
to the actual skills and behaviors needed by guidance personnel to develop 
their programs in. needed ways. A third key concept is evaluation^- Programs 
cannot progress until they can develop means of set^i f>^, objecti ves and inea- 
suring progress/toward those obje-ctives, an'd this principle was central to 
the program*development process deteloped^in this picojecn A fourth is the 
idea of efficiency. So much is going on in various places, and communication 
gaps are so widespread, that efforts are often duplicated, and progress is 
often halting. The pVoject tried to. determine what has al ready been done in 
guidance staff development, to catalog this so others can have that informa- 
tion, and to reference useful materials and approaches into its own staff 
. development program so that those 'interested can make use of the' best that 
is available and no wheels will be reinvented. 

This project's research hypothesis essential iy> 'was that guidance 
personnel who experienced a staff development prototype series.- of activities 
, would demonstrate significantly more program development competencies and ^ 
more posi tive attitudes toward such program development than they had before 
this experience. There are thus two parts to this hypothesi s--the competencies 
and the attitudes. • ■ 

At least' as far as the subjective reactions recorded in thi^ study ere 
concerned, participants did improve their program development competencies. 
^1*1 their rating of themselves, they improved an average of .47 points on a - 
Tour-point scale at the. inservice settings, and an average of 1.18 points in 
the college class'. Coordinators rated inservice participants as having 
achieved the majority of module objectives. Most participants felt that at 
least 50? of the modules helped them to acquire and practice skills useful to 
them, that those skills would be useful for guidance people in general, and 
that they were now well prepared to us&^hose skills and related specific 
methods in their own scho61 settings. In short, to the degree the measurement 



is accurate, it can be concJuded that most of the participants felt they 
im^iroved some of their prognem development competencies and Coordinators 
substantiated these opinipns. More objecti ve data on immediate &nd follow- 
up ^kill acquisition will be collected in subsequent field tests of these 
modules. 

The data are much less, clear in their sugxjesttons about positive change 
in attitudes of participants. Desire to improve programs was increased some 
what in inservice participants * but not dramati caJ ly . This variable was not 
measured in the college class because the participants lacked a personal 
setting in' which they could be expected to transfer acquired skills. Unan- • 
tic'ipated effects and general cr4ticisms and suggestions reflect a mixture 
of positive and negative feelings. For example, the follow-up interview at 
the second inservice site showed 56% of'the respondents felt the \w.orkshops: 
could have been more effective. The majority of comments received in de- 
briefing sessions ^t the end of the workshops were negative, some were 
outright hostile. The preservice end-of-quarter class discussion showed • 
fairly positive feel i ngs wi th a sprinkling of negative ones. To summarize," 
many posi ti ve ' and negative feelings were evoked, and it seems impossible to 
clearly conclude that "significantly more positive attitude^ toward program 
development" were demonstrated. '. 

Cone I luj iom' , Ri,'cormni'nda ttons ^ ■ . ■ 

Some useful clues about the audience 'for which the prototype is best . 
suited seetTi apparent. Competencies developed by preservice participants 
clearly , outstripped those of inservice participants, at .least by their ov^n 
estimate. Preservice participants were less familiar with the ihformation 
in the modules beforehand, and had had fewer; previous learning experiences* 
related to the topics ; this seemed to make the experi ence more worthwhile 
for them. They tested higher in the post-workshop knowledge exam. They * 
provided generally fuller and more positive comments on reaction fom^. and\« 
seemed much more positive in their debriefing at the end Of the experience. 
Their lack of a program of their own may represent a disadvante^ge, as it may 
mean thes? partici pants lacked perspecti'^e to judgfe their ability to achieve 
the program development called fc5r in the modules.. Neverthel^s-, this seems 
to be outweighed by other factors. The prototype seems better suited to a 
preservice than an inservice audience. . 

In the line of recommendations, improvements can be effected in both the 
materials and delivery of the prototype. Chief examples in- the former cate- 
gory ^re: ' . 

• Orienting the content toward a more sophi s'ticated au(iience for 
inservice applications • , ■ /, ' 

• Strengthening the practical orientation for ins6rv1ce appl ic^ations 

• Shortening and simplifying textual sections ' 

• Simplifying the vocabulary * . ^ • 

• Upgrading' the quality of particular .phases; i..e.. Phases* 3 and 4 

• Improvi ng. the , eval uati on instruments 

Chief improvements possible in the delivery of the prototypes^ are: 

• Improved orientation, combined with an adequate n^eds assessment * 

■ ' i ii 



a Improved trainiri(} of Coordinators 

• Improved facilities and schoduUng for tfie workshops ^ 

• Designating some of the workshop tasks as homewo»;k- tasks aVid 
allowing more individualization • . ^ 
Careful selection of settings to avjbicl ;'bpfore-the- fact negative 



attii tudes j!f 
• vAdministerjmj the prototype to onlyVi genuinply voluntary inseryice 
audience / 



. , In suiTinary, aJairly extensive program (72 hours) of competency-based 
instruction was dejbloped and field tested. Results were mixed, with com- 
petencies increasing to a degree, and atti tudei • toward the experience a 
mixture, of posi ti ve' arrri negative. Central to a successful experience with 
the self-development materials and procedures seems to be a selection ot the 
most apjbropriate audience for them, and'the preservice audienfce fared better 
than iniervice ones. A number of improvements could be made J'n both the 

.rfeterials and their delivery. With such improvements and refinements, th(? 
prototype could qui te possibly make a significant impact on one area of 
education. - • n.^ 
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tach of 'these 12 moduli consists of a participant's manual and a Coordinator's Guide. 
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This report has four basic sections: 

• Methods ^ 
t Results 

• Conclusions and Recommendations 
9 An Appendix 

The "Methods" section is a report on the project from the management 
s*tatidpoint> It describes the activities and accortipl ishments of the project 
over the 18 monthV of its duration, discusses thef ma jor' probl ems encountered, 
and summarizes the staff utilization. / 

The "Results" section focuses on the project's research findings, 
summai^izing the data-from the field tests 'and analyzing these to allow for 
appropriate conclusions. It has four subsections: 

• The Participants ^ 

t Impact - Competefic ies Developed 

t .Impact - Reactions '^o the Experience 

• Influencing Factors 

The "Conclusions and Recommendations" section synthesizes the findings 
of the research and presents the appropriate conclusions to be reached. It 
also draws the implications from these conclusions in the form of a' series 
of recommendations. 

Due to its length and detail, one digest has been moved from ttie "Results 
section to the Appendix. A separately bound volume entitled "Supplement to 
the Final Report: Papers and Instruments," of less general interest, contains 
all of the, various instruments and documents produced by the project. They.- 
fall into.,. the following categories: 

A. The Integrated Model 

B. The National Search Materials 

f C. Th6 Pilot-Test Evaluation Materials 

D. The Field Test Evaluation Materials 

E. The Fo^ Tow-up Evaluation Materials 

F. The Concept Paper 'f 



In addition, it, should t)t^ noted that the ()roje(.t pr-oduciul th(^ toi lowing 
products, wfiich totjut.fier witf) tfns report, constitutt^ the^HUni t()t<)l of l\\o 
project's products: \ 

• Twelve moduh^s, t)Ound in five volumes, labeled "Orierjtation" 
and "Phases 1-4" . , 

• Twelve Coordinator's Guides, bound and labeled as the modules 

• five tape-slide productions, paralleling the five \rolumes of 
modules 

• A catalog of competency-based staff development programs and 
statements of competencies, th^ result of the project's national 
sear'ch 

The question which this ^project set ou-t to answer is stated in its 
research hypothesis, page of the proposal: 

Selected State, school district, and school personnel involved 
with guidance, counseling, placement, ar^d follow-up programs 
will demonstrate signif icarftly more program development com- 
petencies in both simulated and real-life situations and signi- 
ficantly more positive attitudes toward such program development 
after they have experienced a staff development prototype series 
of activities (i.e., competency-based packeiges and technical 
assistance structured by checklists) than competencies and atti- 
tudes they^ demonstrated on repeated measures administered before 
they w^re exposed to the prototype. 

A brief elaboration of this statement would probably serve as a useful 
introduction to this document. - - 

"Program development competencies" *are the key words in this hypothesis. 
School guidance personnel are facing something of a crisis currently. Budget 
cutbacks^are forcing administrators to take a hard look at "nonessential" 
programs; and oftert dne of the first places they look is to' guidance programs 
Such pronrams seem to lack the clear accomplishments and rationale of in- 
structional programs. Often counselors "dt) their own thing," mostly indi- 
vidual counseling, and the guidance -program lacks any program-wide objectives 
at all. Certainly such programs rareiy^eval uate their accomplishments 
thoroughly. And in providing largely individual counseling, they often fail 
to provide the career guidance that young people more and 'more clearly need. 
It is our contention that if guidance programs can be induced to measure 
studeat needs, set out clear objectives that include the career guidance 



ritM'ds, c hoosr (Mfoctivo striUtMjies that; will rHNu:h ldr'(]e numbers of '^tu(h'nts 
(lis oppostfd to ''iruiiv iduci 1 c.ounse 1 inij ) , tind ovti 1 ud to . thei r- ef forts to 
tfraiMd t i cd 1 1 y dt^nonstrAtt* to ddiiiin istrators (iwid taxpdyt^rs) wh?it (h(»y ar'O 
in.coinpnsf)ini|, thoy will both iivoid oxtinction and iiiiprovo thtMr usetulru'ss. 
It is thoso kinds ot actjvitios tfiat we fiKMn by "proqr'c^ni clove 1 ofunon t . " 

The prot)1e!ii is tfiat traditional staff development pro(jraiiis for ijuidahc.e 
personnel do not teacfi tfiese thinqs. 'They focus on "counsel i ruj" ( n the 
narrow stnise), and rarely yo beyond knowledge and attitude outcomes.* A 
"competency-based" program demands that an individual be 'able to demonstrate 
a usable skill, fhe- centra V- idea behind our "staff development prototype" is 
that guitlance personnel l)e given the skills needed to f)lan, orcjanize, and 
evaluate tfieir programs efff^tively. A look at the titles of the \? modules 
on the Circular fiiodel on tf/e next page will convt^v in more detail wfiat tfiese 
skills are. The phases a^/e groupings made laroo flW l for convenience sake, 
and are indicated by th(/' dark arrows. 

To rephrase our hypotfiesi's , then, it 'was our hope to improve the skills 
of guidance personnel in these areas; and to have them become more concerned 
about and enthu^ii i as t i c toward such concerns. This is a report on how we did. 
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METHODS • , " . 

— ^ ^ \ . - ^ ' 

^■Maoor Activities and Accomplishments During the 18 Moy.ths 

^ A% * -Integration of 'the [American Institues: far 'Resea'rch (AIR)^ 

■ and the State- of/ Calif ornia Progrdrn Devel^^ 

5i The National' Search ' / • • 

C. Development 'of Prototype • ' • .^^ 

1. Module Content locus ' '■ '( 

■ .2. Module Formats'. . ' " 
3. Production of Modules ' . ^ • . 

^. Additional Prototype Materials ^ 

. ' p. Pilot Testing ^ ' 
' . Module . Revision 

F. ■ FieM Testing . >. . • 

G. Concept Paper . 

. . ^. National Advisory Panel Meeting 
I. . Dissemination . ' . , • 
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A. Integration of the American Institutes .for Research (AIR) and the State 
of California Program Development Models . 

The two models developed Independently were thoroughly examined. v. 
California has produced a series of six monographs and a 'Master Plan for 
the state, together describing In some detail the model for Improvement of 
guidance services In California. AIR has worked over the past several years 
developing Itsmodel, as described In Developing Career Guidance Programs^ 
published by Educational Properties Inc. The essential common elements'were 
explored. A series of discussions and me.dtlngs were held with Dr. Anne Upton, 
Director of Guidance Services in the state education department, and members 
of her staff. It was decided that since the two model s are so closely paral- 
lel, and/the real iteed now is.for action and implementation of them, a 
brief and succinet document would best serve as the integrated model. This 
was drafted, revised, and distributed to the National Advisory Panel for 
revi^^^: It was then discussed at the Panel meeting in September 1974 and 
suggt^^stions for changes" were gathered. It was revised accordingly anilns. 
Included in its final form as Section A of the supplementary Volume ^of 
this report. 



B . 'The National Searc>i ' . • ^ 

A^earch letter was coniposed describing what it was we were. looking 
for and requesti ng information-arid/ar materials related to'Jthis. A prepaid; 
; postcard was ..prepared Vjor easy response. -A^'fol Tow^up. -Tetter was al ^.o Jpre- ' 
^ pared.; .ATl^^^three arq contained^ .i n -Sectian B of th^' supplementary volume of. 
this report. These were-sent in November and December. 1974, the follow-ujJ . 
letter approximately one month after the original. / ^ ' 

A mailing list with approximately 1200 names was developed, drawn from 
several -sources:. .; / " - ... 

1. All institutions of higher' education with counselor education 
programs 

2. All publishers active i n* educational fields 

3. All state departments of . education ' ' 

4. All. members identifie'd on American ^Personnel and Guidance (APGA) 
mailing-^lists provided by various division presidents in ^'five areas 

a. School counseling ' \^ 

b. Rehabilitation " ^ 
^ c. Group counseling' . , . , . 

d. Higher education 

e. Corrections 

5. All state vocational research offices 

6. All federal regional educational laboratories ' ' 

7. All relevant (from past work) research and development centers 

8. A selection of sources sifted from a searcf^of Stanford University's 
data bank ^^'teaahev competency-based education programs. 

This entire list was put on MTST tape for easy reuse and subsequent mailings. 

A full library of responses was maintained, based on ' 
information ^provided on the response postcard. Materials were likewise 
c.a^taloged and shelved according to a prearranged filing system. Follow-up 
cal Is werljiiade to several dozen promising sources for additional information 
and materials. 

All received materials were reviewed and preliminary abstracts drafted. 
Two basic categories were decided on for catalog descriptions:- actual staff 
development programs, and statements of needed guidance staff competencies'. 
Far more of the second were gathered, as this represents the first step 
usually taken in moving to a competency-based program. Those abstracts 
requiring additional information were identified and additional contacts 



made via; telephdne. A- format for the full catalog descriptions was decided 
upon.v ^' ' ' 

The catalog was drafted i#the spring .of and f inal ^additions made 

over the summer. It 'was ther^evlewed , revised, edited, anJ^rinted in 
Novexqber 1 975. • z Approximately 40 copies were distributed to individuals who 
\had. cooperated by^ contri'buting materials, and ^pp^^^^j^g^^^y g^Q^^g^.30 
-distri.buted to jtrof ess i;^na]. contacts interested -j^ its use. In agjdition, 
it was described in a flyer'which was- sent'tp dl| those on the original, 
mailing list, and mad^ a\tailable through the AI|^ publications office' 
to the:' general publj'ci '^V 

. ■ ' -r . , ' / 

, C. Developmeyit of Prototype « 

Since this category represents the singl.e;,^biggg^^ ^ask c^ri'^the project,^ 

it has bee/ subdivided into four categories -^"^ "•■ 

/ ' ' * . ' •■ 

1. /ModuJ^^Gont ent Foqus * ' ; . ^ - ' 

/ — — ' — ^ ^ ' 

Determining the- precise topics of the niQ^jy^g^ involved a lengthy • 
series of discussions among project staff iriembe^s^ consultation with outside 
experts and consultation with the National '^^^-''Spf,y pg^el members and the * 
project monitor. Many criteria were considered. |_.^^^ possible topics 
were developed, reviewed,, andWvised. It ^3^. '''inally decided,' 'in October 
1974, that the skills of planning, developingy implementing, and evaluating 
comprehensive programs of career guidance, '^o^'^Seii placement, an^^llow- 
through should be^ the sole focus of the modules, .j^^j^ fits' W*±h.: 

1. The highest needs determined in P^^viqus studi es ""^^"^^'J:/ 

2. air's experience and experti^s^ 

3. U.S.O. E. ' s priority determinations 

4. The need to limit the topics to an ^^^^ ^^^^^ plough that 
there" was a reasonable hope of etti^.. del i vering the 
needed skills to the target am^iencg "^'-^ , ^ 

■As search materials came in, -they were y^^^^^^^ for their useful- 
ness in contributing ,ta the module topics decide^j ^^^^^ ^^^^^ ^^^g ^^^^^ 
materials did prove useful , no single set of "^^tey^^g^g ^^35 uncovered that 
could simply be adapted into a module, fhus ou^ original -hppe bf "adapting 
three to five compfrtency-based staff development packages 'discovered in the- 



national search** was frustrated. "Instead, we determi ned- that we would have 
to develop the ful'l quota ourselves. , . 

2.' Module Fprmats 

Included In the task^ here were the gathering of feedback fr^m try 
outS;of earlier versions of module«-developed at AIR, and consultation with- 
experts on the 'most. effective delivery methods of staff development programs 
A series df meetings among project staff , and outside consultants were he.ld 
'•from July through November 1974, cOns.ideri ng- such tiasic structural factors „ 
as: module performance objectives, necfessciry subparts of a'nriodule, activi-;-' 
ties, discussions, simulations, built-ln assessment and evaluation, applica- 
tion of skills to participants' own settings, use of extra-module resources, 
and use of technical assistance. Other variables, discussed" and for which 
determinations were made included:* length, writing style, nature and fre- 
quency of examples, use of s^ca rtgon s , ' graphics , binders, page layout,' o^gani- 
zatioh of subparts, level^or^aBKl &hd sophist;ication, and the need for 
and nature of effective orientSWtn. With the , necessary definition in all 
these areas, it was possible to proceed with assigning modules to writers- 
and actual development of materials. , , < 

^3. T^roduction of Modules ' - 

Once the module topics and formats had been defined, each module 
was assi^ed to a writer. All assignments were made by November 1974. 
Working with a set of guidelines developed by th'e project director, and ^ 
resource materials pulled together from many sources, each writer made a 
thorough study of his or her topic and developed a set of precise specifi- 
cations for the module. These included the behavioral objectives (at least 
three skill ones, generally four to six total per module) the module would * 
deliver on, and outlines of central parts .of the module (reading sections, 
activities, discussions, assessment sections). These specifications v\/ere 
reviewed by senior project staff and feedback given writers in aperies of 
meetings. Most sets of specifications were revised at least once, many two 
or three times. 

; 

Once the specifications were agreed upon, writers developed first 
drafts of each module. All writers began this tHk by the end of December 
1974.. A constant process of communication was carried on among writers, 
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senior project- staff , 1 ibrarians/, outside experts, .and AIR in-bouse experts^^, 
during this period. Drafts were typed, reviewed, a^ .revised ^egularly^. - . 
By March all modules except one were ready for pilot test production. 

Prbduetibn involved typing, cartooning, obtaining reprint permis- , 
srions,. adding headliner headings, inserting dividers between, sections , pagi-. 
natipg, obtaining and preparfng binders, reproducing origjnals, and final 
'checking prfar'to pilot testing; The pilot test occurred 1-3 April 1975. 

4. Additional Prototype Materials - ' 

While the modules constitute the heart , of the staff development 
prototype, certain supplementary .materials were^.ilso agreed to. Therfe are 
three main example's: tape-slide introductions for the modules; technical ' . 
assistance aids^to supplement the modules; and evaluation materials beyond 
those contained in the 'modules, to be used in the pilot and field tests.: 

Work on the tape- slide introductions involved determining the 
nature, number, and focus of these*!! Expense made producing one of these for 
each module prohibitive. Since their main function was to provide illumi- 
nating, motivating introductions, it was decided to develop just one for the 
whole set of piodules. A script was written, photographs takefi, a tape pro- 
duced, and the production assembled for 'use at ^he pilot test. Feedback 
from the pilot test suggested a number of changes a^nd resulted in dividing 
the tape-sTide into five segflients, using artwork through each, a professional 
anncfUncer, studio production of the tapes, and expanding the production to 
include more detail on the nature of the modules. Production work on these . 
tasks was' completed in August 1975, and the revised tape-slides were used 
in. the field tests. 

The task of producing teahniaal^ assistance aids to go with the 
modules involved first defining the most useful naturef of these. Since all* 
feedback pointed in th^direction of a-larger role for the module coordina- 
tor (moving away from eaVWer programmed learning versions of^the modules), 
it was , decided a bookt^/ Vh>ch would be helpful in defining and performing 
this role was nios.t se^ible. Called Coordinator's Guides, these were 
developed by writersAt the same time as the modules. For each module we 
included a lightweight introductory activity to get participants involved, 



introductory remarks appropriate to the topic of the modul e , feedback for, ^ 
the discussiorvs.and activities, criteria by which to-measure successful / 
accoiflplishment of all* module objectives; an introduction for the appl icatiort ^ . 
section of the module, and general role definitions for the coordinator .< 
along with a specific checklist of functions keyed to each module. Th^se ; 
were drafted, reviewed, pilot tested, and rev4^ed along^with the module^ 
CooVdinator' s Guides were compl eted .and printed ijr\ August "1975.. ^ / " • 

Pilot test evaluation instruments were prepareVwiibh two fe'^rposes in 
mind: module review by experts (National Advisory Panel members,, the project 
monitor, Californi-a State Education Department guidance sta'f.f members, consul- 
taats) ^nd for use by parti cip.ants in the pilot test, gne instr.ument cal ]ed " . 
a Module Review Foivn wa§ developed fn the' first category. For the pilot test 
participants, a battery of forms was prepared which included: 

' • Participant Information ^Questionnairi^. ■ ' ^ " * 

% ^^'i^jxle Evaluation Packixge ^ , - • 

J Corrparison of' Modules (Prr and Post) • . ■ ^ ' 

• Participant Assessment Form : . ' , ' 

In adctjtion', evaluation instrumerits wi thi n the modules were used includi ng : 

• ^^^odul e^'-pi^^ • - : ' . . 
t y^odule postas^essments ' . * / 

^ • ! Competency checklist (in 'Module. 2) . , ^/ 

All of the first four instrument? are^incTuded in Section Z of the supplementary 
volume of this^'^ report. / . / , . ^ ^ " 

D. Pilot Testing • - ' ; ^.^ '^^ ' ^ , ^ 

The'pilot test'^^j^s held f rom. 1 April 1975 at. AIR, Palo.Aito and was ^ 
conducted by senior project, staff with help from ^^^^ ^"yj^^^^^s . All 
participants (16) spent. the first day on orientation (two modUl el^.and t^en 
selected two additional modules '|pP* the subsequent two days. Parti'gi pants 
worked through the modules as trai nees , /ST^Ttr^same time they critiqued, them 
and provided their reactions and ^^ttff^^WN^^^^fJ^ improvement. 

The group included in the piloft test represented a broad range of posi- . 
tions, levels, and locations, twelve s-chool districts were: represented, 
with a mean number of 9.1 years in the district for each participant. 
Ninety- three percent of the participants held both bachelor and masters / . 
degrees, 30'^ doctorates. §7ie .hundred percent had held teaching positions, 
€7% counseling positions, 47% administrative positions, while twto. were 



psychologists, one a dean of ^students , one a guidance consultant, /and one d 
guidance coordinator.' Mean age was 44 years. Appro^cimately equal numbers' 
of men and women were represented. ^ 

A great deal of feedback was collected. It was fairly balanced between 
positive comments and criticisms,. The pilot test was intended to seek sug- 
gestions for improvements for reyision however, and it succeded in this 
regard. The following very briefly summarues^he, feedback received. . 

Positive Reactions 

• Use of coordinators, and their helpfulness 

• .Tape-slide introduction . ^ * 
^ • • Intrbdupkory activities * . 

•*lighf, well edited reading; examples 

• Discussions ■ ^ 
•'v Cartoons 

• 'Formatting., ' ^ 



Negative Reactions 



• Lack of adequate overview; orientation ' 

• Length - too much material . • 

• Heaviness of the, text, use of techriicaT jargon . . 

• Preassessment - being tested befo^^e hayi ng chance to^ learn ■ 

• Simulations - having to think thrwgh hypothetical situations 

• Readings outside the module 

• Application - leaving it until*th€ end ; , 

We summar;ized all^he information, integrated feedback from National Advisory 
Panel members, i n-house, experts , and state education department personnel, ^ 
and in mid-April 1975 began revisions in preparation .for the field test. 

I - . ■ -J' , 

E. Module Revision . 

The revisit)n process was an extensive one. For each module, we did the 
fol lowing : / ^ 

• Spread the activities through the module, so that instead of /• 
'having-all reading together followed by all activities,, the 
module had small sections of reading, each followed by a dis- v 
cussion and/or activity 

. • Moved parts of the appl ication activities to earlier sections pf 
' the module 
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• Added practice ar<!tiyi ties; reduced' reading 

t Structured discussions around participants' own settings rather 
than hypothetical settings 

,• El imi nated the. preass,essmehts ' ' ' • 

• Expanded -the glossaries • • ' 

• Improved layouts with additional boxes, bold face type, color 



coded pc^ges,'and add»ftional cartoons ^ 



• Carried,;^ut^t editing to eliminate jargon, lighten the , k 
tone, ft''^,ari% the style, add examples, add summaries at the jF 
beginnirig and end of sections of text, and in geneml , make UMr 
modules, easier to' read M ^^.^^^If 

• ."Added ^in appendix to accoroiodate ^'ilsential extra-mHttli^''Wadings. 

. Most readings were eliminated.*' 

This required a writer an averge of a week's additional work per module. 
It also involved going through an entire, second round of typing and production 
tQ prepare the modules for printing. Al 1 ■ modules were finishecj and-printed 
by ^Augusf 1975. . 



F. Fi^eld Testing 



; - 



The modules were field tested in three settings: Mesa Verde, a high 
school near 'Sac raWento, California"; Grossmont, a school district (nine schools 
: ]wiere involved) near San" Diego, California; .and in an undergraduate class'of 
■. CTr. Nor^nan Gysbers' at the Universi ty. of Missouri, C^lumbfa, Missouri. Dates ' 
'.'■and numbers of ; partici ts for eatfh of these field tests were: , " 

•M -J . Location . Date 

18 . . ■. . Mesa Verde • August 25-28, 1975 

47 ' Grossmont - September 29-Octobtr 9, 1975 

■ ''9 Dr. Gysbers' ClasF^ Fall quarter, late August- 

• ^ , early December, 1975 

At both Mesa Verde, and Grossmont a'selection plaia was used so that any one 
participant would only work through a limited number of moduleS'-genefally 
one. phase., fn -Dr. 'Gysbers ' class, participants worked through all 12 modules. ^ 
Since. results of the field tests compose the, results of the research , ''and 
the. exact nature of the participants is related to this, further 'detail o'n 
these field tests will be oinittecj here and left for the "Results" section. 
A full report on their outcome is included there. 
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G. Concept Paper" ' " - 

A commitment ^of the project was to produce a concept paper for the 
expansion of the staff development prototype produced on this project to 
additional topics with field testing in four states. Originally we intended 
to develop this paper toward the end of the project. Instead we decided to 
produce it in the fall of 1974 and cfrculate it to interested "states at that 
time. This led to -a proposal which was submitted to the same funding source 
as ft)r th^s project, for fiscal 1 975, and eventual ly to the funding of Pro- 
ject'G007500347. This concept paper is included as Section F of the supplementary 
volume of this report. - ' , 

■ . ! 

H. Nati onal Advi sory.^^nfil Meetirtg^ ^ . 

... .- ' .^.^ '.'i': " ' ' i ' 

In accordance with the proposal, a National "Advisory Panel meeting was 
held at AIR, Palo Alto on 26-27 September 1974. The following were present: 

Panel Members : 

Ms. Lillian Buckingham, Director (retired) 
Baltimore Public Schools Placement Servicer. . 
Baltimore, Marylawl 

Dr. W^iam L. Cash, Jr. ^ 

AssislBt to the President for Human Relations .Affairs ' 
University of Michigan ' ,:ivrv4^ 
Ann Arbor, Michigan ^ 

Dr. Norman Gysbeifs, Director. ' " 

Career Development, Guidance, Counseling, and Placement Project . 

/ University of Missouri. j-^' 

Columbia, Missouri 
^> • • 

Dr. Lorra^'^' Hansen, Professor 

Counselor Kucation ^ ' / 

^ University of Minnesota 

Minneapolis, Minnesota ./ ' * 

Dr. Dav*id V. Tiedeman, Professor . . ' . " ^' 

ERIC Clearinghouse in Carefer Education 

Northern Illinois University ■ 
DeKalb, Illinois • 

California State Education Department Representatives: 

Dr. Jay Rollings, Guidance Services 
'Dr. .James Crandall , Vocational Education 

Project Monitor: 

Mr. David Pritchard 
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Project Staff: . ' . . 

Dr. G. Brian Jones, Dr. Anita Mitchell, Charles Dayton, Carolyn Helliwell, 
.Laurie Ganschow [Harrison], Laurie Hopkins, and Phtl ip. Clendaniel 

Topics covered at the meeting included; 

• J^eview of the time aad task analysis developed for the project 

t Review of the i\ntegr^ed model ' ^ 

t Discussion of tf^e search (the letter, make-up of the mailing list, 
purpose of the Search) ' ; 

t Target audience for the modules 

Topics for the modules 




: t\Defini tlon of '"competency-based" 

t A nunjber.of more detailed issues related to module definition and 
intended use 

^ ' ■ • ' ■■ ■ 

On ^ach of these topics panel members and others presented their ideas 

and reactions and in most cases the group^ reached a satisfactory definition . 

.with which to proceed on the project. Panel members agreed to be available 

as resources\in writing, modules and to review drafts as they became available. 

A second \National Advisory . Panel meeting was'^briginally scheduled for 
, the fall of 1975. Partly because of the Tack of contact the panel, had had 
with the project, since. the first meeting (see the "Problems" sectid^ 
following), and partly because there seemed to be little compelling reason 
for the meeting, the Project Director made a tentative decision to cancel it.' 
He then checked with the Project Monitor to obtain clearance fc^r this de- 
cision, and asked the Panel 'members themselves their views on the decision. 
All agreed it was a sensible decision. In the meeting's stead, the Project 
Director offered to pay a visit to any of the Panel members so desiring it, on c 
swing through the East he was making for another project. Three members so 
requested and received -this visit: Dr. Cash, Ms. Buckingham, and'Dr. Gysbers. 

I . Dissemination . 

A number of dissemination activities have been conducted. One hundred 
extra copies of the modules and 200 of the catalog were printed for general 
distribution. These were paid for by AIR company funds, not project funds.- 
Permission was sought and granted for this effort from the USOE Contracts 
and Grants Office. , A letter and flyer describing these products were sent to 
all individuals on the National Search mailing list. This served the addi- 
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tional function^ letting those from whom we sought help know that their 
help resulted 4n concrete prjpducts which they could "now obtain and use. 
As of the date of preparation of this report, approximately 75 copies of the 
modules and 50 copies'. of the catalog had been sold. 

Two project staff presented a wo^shop based on the modules at the 
American Col lege. Personnel Association Workshop Fair oh October 28 in St. . 
Louis, Missouri, ' 

ERIC-CAPS at the University of Michigan under the direction of Drs. 
Garry Walz and Libby Benjamin will pOblish a 100-plus pdge ponograph as part 
of a series of special Intact publications whiyh will be largely devoted to 
the work of this project. Coauthored by G.. Brian Jones^ Charles Dayton, .and 
H,B. Gelatt, it will describe the planning-evaluation model behind the ^ 
modules, their nature, and how t|>ey will develop; the skill's needed to^^ffect 
this approach, and some of thjs student materials that can be integrated with 
thi s' approach. The title of thi s- monograph wil] be I^ew Methods for Delivering 
Human Services > ^ ^ 

A. new resburc^^ book for/graduate students in guidance and 'Counsel i ng , to 
be entitled i^iew Horizons In Counseling Psychology ^ will include a chapter 
describing our competency-based staff development approach and provide an 
overview of the results of the national^ search . The chapter, authored by 
Charles Dayto.n and Brian Jones, is entitled "An Innovation in Competency- 
Based Staff Development for Program "Planning," and is approximately 35 pages 
in length. The book is being assembled by Dr. Chris Hatcher at Langley V 
Porter Neuropsychiatric Institute in San Francisco and Or. Bonnie Brooks jat 
Texas State University at El Paso, and wi 1 1 be published by Albion Publisiiers 
of San Francisco, California. * 



, . Problems • ' , 

There are, of course, innumerable problems encountered over an 18-month's 
duration, and it is a difficult task to separate those worthy of mention frm 
the routine. Those selected here have been chosen betause in some way they 
have altered the original plan of action on the project. There are five such 
examples, 
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The response to the national search was disappointing, in two regands. 
First, in spite of the iact that respondents needed only to check a multjiple- 
choice item on a prepaid postcard, only 57% replied, "tecond, of the orig- 
inal sampling of 1235, materials were received from only 126 individuals, 
or 10%. Both of these were disappointing results, reflecting the rudimentary 
state of the art in competency-based education of guidance personnel. - ' 

Directly related to these results was the fact that we were ufr'ab'le to 
adopt any materials from the search into modules. As explained in section 
• ICl, there simply were, no materials received which were of S'ufficient quality 
, ^nd met with our topic selections to be of use. This meSnt that we had 
tb do more work' ourselves in developing modules fif%m scratch'to reach the 
numbers we agreed ""to produc^. 

■ A third diff icul ty^relates -to the' role of the, National Advisory , Panel . 
As the proposal was originally wri tten, .^this body played |an important role 
in evaluating project products. The budget cut6acks mandated when the pro- 
posal' was funded cut the amount this group could do, and its. role became pri- 
marily one of reviewing and overviewing. 'It could not meet often enough to 

^e involved in most of the important project decisions or provide regular 
substantive feedback and thus much of the value original ly hoped for from 
these national experts was lost. 

A fourth change from the original plan (not realty a problem) was a 
redefinition o-Tthe pilot test participants. Where we originally intended 
to have 'the state"^epartment personnel serve in this role (since they would 
subsequently lead the modules In the field tests), ,it became apaarenf that 
they could more .useful ly serve as reviewers of the modules an^help in their 
development. Thus we selected a group of practitioners from the San Francisc( 
Bay Area as pilot test; partici'pants . This proved more satisfactory on all 
counts, as it provided us with feedback directly from those faced with the ' 
day-to-day problems. 

■ The fifth pr-oblem was the difficultly of finding suitable field test ■ 
site's for the modules. " While sites were found, the task was an arduous one. 
The immediate problems schools' were trying to deal with were becoming more 
and more overwhelming. Finding districts with enough money and foresight 

to release personnel to develop skills related to planning and evaluating 
programs, subjects with long term but not necessarily immediate benefits, 
was not easy. 4 



Each instance that required a change in the definition of the project' 
plan of -'action was discussed with the project monitor and cleared ahead of 
time. On balance, the project probably had fewer problems than most. 



Staff Utilisation 

Following is a list o]f project staff and their titles, their role on 
the project, and their period of employment -over th^ 18 months. ^ 



Name and Title 

G. Brian Jones , 
Principle Research 
Scientist 

H. Bs Gelatt, 
Research Scientist 

Anit^ Mitchell, 

Senior Research Scientist 

Charles Dayton, 

Senior Research^.Associate 



Role on Project 

Responsi b^le 
Investigator 



Responsi bl e 

Investigator, 

Writer 

Senior Reviewer 
Project Director 



Laurie Ganschow [Harrison], Writer 

Associate Research 

Scientist 

Barbara Sanderson, Writer 
Senior Research Associate . 

Jean Wolman, ^ [ Writer 

Senior Research Associate 

Carolyn Hel 1 iwel 1 , Wri ter 
Research Associate 

Sarah Roberts'^ Writer ' 
Senior Research Associate ^ 

Steven JuT)^., Evaluator, 
Senior Research Scientist Writer 

Barbara Pletcher, - Writer 

Research Associate 

Jurgen Wolff, 
Associate Communications 
Specialist 

Phi lip Clendaniel , 
Research Assistant 



Cartooni St 



National Search 
Coordinator 
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Period of 
Employment 

2 months 



7 months 

h month 
12 months 



hths 

1 month 

months 
h month " 
1^2 months 
1 month 
1^2 months 
^2 month 

8 months 



PS 



Name and Title 



Role on Pyject 



Susan McBain, Catalog 
Senior Research Assistant Writer 



Phyllis Dubois, 
Consul tant 

Merlynn Bergen, 
Consul tant 

Beverly Harlan, 

Administrative 

Ass-^^.tfint 

Jean Reynolds , 
Secretciry . 



Writer, Editor 



'"^Evaluation Instrument 
Production Supervisor 



Typing, Production 



Period of 
Employment 

2 months 



1. month 



15 days 



4 months 



5 months 



In addition, the five^members of the National Advisory Panel spent 
two days each on the project at the September 1974 meeting, and a variety 
of personnel helped in small. bits on the production of the tape-slides 
(photography, modeling, artwork, announci ng * and tape production). 
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RESULTS 



Introduction - ' ' ■ ' 

This "l^esults" section will hav6 four basic divisions: 

• The Participants " 

% impact - Competencies- Devel oped ' 

• Impact -Reactions to the Experience ||p 

• Influencing Factors 

"The Participants" section will briefly describe the number and nature 
of the participants in the three settings in which the modules were field 
tested: Mesa Verde, Grossmont, and Dr. Gysbers ' Class . The "Impact - 
Competencies Developed" section will present the majority of the data col- 
lected, particularly where they provide ^ome statistical indication of what 
v.'as a-chieyed. These data will be briefly discussed to indicate the findings 
of most interest. The "Impadt - Reactions to the Experience" section will 
summarize comments made on various of the data collection instruments *and/fn 
debriefings, and will jbry to capture the fieelings and attitudes of partici- 
pants toward trieir experience.. The "Influencing Factors" section will brii 
summarize the more important no,ntreatment "contaminating" factors that 
affected participants 'attitudes toward their||xperiences. 

One general point should be made here. This project was never intended 
to be^ A hard scientific, inquiry which would use experimental designs and 
Carefully controlled tests to produce convincing parametric results. It 
developed approximately 1,000 pages of training materials, and made an 
honest attempt to try them out on the intended audience. Much useful in-» 
formation is available concerning the result.. But each audience was 
small, no controls were included in the tryouts, and the data were not as 
objective as possible. Practical constraints often made it difficult to 
obtain full and desirable, responses from all participants.^ A school work- 
shop is not a good experimental laboratory. We do not apologize for the 
• results;, given the constraints and intent, they are qiiite respectable. But' 
we do not pretend they are more than descriptive data that suggest certain 
conclusions. They are not hard scientific findings that have undergone 
soph^sticate^d statistical analysis. 
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Mesa Verde is a rural /suburban high school about 15 miles east ' 
of Sacramento. It is on an experimental year-around schedule, currently in 
the second year of this schedule. This is what made it an attractive site, 
since it could accommodate a field test over t|| summer, and its staff had 
.^begn selected for their interest in innova'tion and openness to change. 

Grossnrant is a suburban district about ten miles east of San Diego, ^ 
composed o'-fiin high schools and numerous grade and junior high schools. 
The district had recently cbmpl eted development of a Master Plan for Career 
Guidance and Counseling, closely "paral 1 el i ng in thrust the central message 
of the modu-les. This made it an attractive site,^where the likelihood was 
high that the staff development to be dllivered through the modules coul^ 
be well received and*take root. ' ' . ' 

A distinction should be made from the start between these two sites. 
Mesa Verde involved one school, a relatively small number of participants (18), 
a shorter time period (two actual training days, plus brief orientation and 
follow-up sessions), and was thogght^as something of a mixture between 
an actual field test and a tryout for the state personnel as Coordinators 
fo,r the modules, and warm-up for the Grossmont experience. No released 
time was provided for participants; they worfCGd a normal school day until 
3 pm and went through the modules between then and 10 pm, with a break for 
dinner. 

Grossmont, on the other hand, involved personnel from nine schools, 
far more participants in all (47), and a time span of two w6eks during 
which individuals could select anywhere from two to six days of actual train- . 
ing. A full day of orientation was provided for everyone, along with a two- 
hour debriefing session. Released time was provided all participants, the 
sessions were held from 9 am to 4 pm, and all Coordinators viewed the ex- 
per|||dH|s a full-blown field test. 

Table. 1 provides information on the participants from these two set- 
tings related to age, sex, education, credentials, positions, and length of 
service in position. A^quick scan of this table reveals the major differences 
between the two groups. As well as being larger, the group at Grossmont was ■ 
older, more experienced, more highly credential ed , and made-up largely of 
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TABLE 


'1 




* 






Participants in 


Field Tests 











Mesa Verde {N=18) 


Grossmont (N^47) 


Districts and 
Schpdls , 
Represented 


Districts 
Schools 






1 
1 




1 ' 
11 


Sex Breakdown 


Males 
Females 






10 
8 




29 

18^ 


Age 


20-29 
30-39 
40-49 
50-59 
60-69 

Mean Age:-^: J'. 'r 






8 
4 

. 5 
1 
0 

34 

*ik 




0 

1 ^ 

18 . 

9 
1 




Education 


A.B. 

M.A./M.S. . 
-Ph.D. 






94% 
33% 
0% 




100% 
89% 

cot 


Credentials 


Teacher 

Pupil Personnel 
Administrator 
Other ^- 


Service 


78% 
11% 
28% 
6% 




89% , 
91% ■ 
28% 

19% .: 


Position held 


Teacher 
Couns.elor 
Administrator 
Other 






72% 
11% 

•33% 
'22% 




85% 
77% . 
23% 
19% 


Length o-f. Service 
in Current 
Position 


Position 
District 
School 






2.2 years 

4.4 " 

1 .5 " 




4.3 years 
8.7 " 
6.3 " 


• • / ■ 
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^pupil personnel staff, as opposed to the heavy weighting of teachers at 
Mesa Verde. 

Participants in these settings used a "team" approach in selecting 
lnodules for study. The time involved in going through all 12 modules v 
(72 hours) is prohibitive. Thus each participant went through an orienta- 
tion, and then selected one phase for study. Variations from thi? general 
pattern occurred in Mesa Verde, where some participants completed less than 
a full phase'(due to lack of time) and in Grossmont, where a few participants 
took two phases^, but generally inservice participants completed only one of the 
^ur. phases. Representatives from any given school general ly spl it up so 
that all four phases were studied and all the skills were represented on the 
school 's staff. • 

While the proposal called for two field tests, one in Northern and one 
in Southern California school districts, a- third possibility , became available 
and was selected. One important question the project dealt with was de- 
termining the best audience for the staff development process involved, Bath 
the planned field tests were with inservice groups— practici ng counselors, 
administrators, and teachers. Testing the modules' reception and impact with • 
a preservice audience seemed worthwhile, particularly when a project was • 
funded in fiscal year 1975 permitting AIR to develop further modules and 
test them thusly. One of the National Adviso/y Panel members,- Dr.^Norman 
Gysbers^ taughTa class at the Uni versi ty of Missouri in the fall 1975 
quarter which seemed well suited for the modules. It was made up of 19 
undergraduates, a mixture of guidance and counseling majors (sophomores) and 
several individuals with experience in vocational training jobs. *Dr, Gysbers 
agreed to use the modules as the curViculum for the course. Thus information 
is. available on their use in this preservice setting, and will be reported here. 
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\Tmp0tct Competencies Developed . 

- Sffiveral kinds of data proV;i<le information on just how effective the 
mbdule|' w^re in^ developing the'tntended competencies. They are: 

.^i The pre-post self-ranking of participants' competence on each - 

. module/ s objectives. 'a 

i The Coordinator's plus-^minus rating of each, partici pant on each 
modiPi'^'s objectives. <^ 

i The 4)aVtici pants', reaction as to , the developmeat of, useful skills 
. as reported in th^Fartioipant Reaction Form,' ^ 

t The participants' reaction as to the improvemfent of their programs 
as. reported in the two-month follow-up at Grossmont, 

The pre-post self-ranking of participants' competenc;^ asked each, parti- 
cipant to rank her/himself before any modules were studied and again when all 
that that individual was taking were complete.j, . This ra'nkMng covered each of 
the objectives for the modules studied. A number of'-di f f icul ties developed in 
this process. First, some participants said they were unable to form a clear 
picture of skills outlined-in the moduleobjecti ves . Second, some participants 
said they needed a standard^by which to* judge their competence— that they were 
only guessing. 'Third, some participants said that the scale provided was hard 
to use, going from "minimally competent" to "very competent" in, one' leap. 
Fourth, participants' self-assessed interest in each module objective was 
gathered on the same form. Some of the Grossmont participants had made deci-* 
sions earWer, at their school, on this point, and thus ignored the form, 
unfortunately also ignoring the competency self-assessment aS well. Fifth, 
there was a reluctance on the. part of some participants Ife rate themselves €t 
all, for a variety of reasons: fear of the consequences (in terms of self- 
Jmage or supervisor's opinion)^ Jiostility toward the form or the workshop 
experience, lack of understanding of the purpose, and so on. In short, the 
data obtained are spotty and suspect. In Table 2, which summarizes these 
results, the numbers represent averages across all participants in the given 
modules. .... 

This table suggests two interesting conclusions. Fi rst, 'parti cipants at 
all. these settings rated their competence before .the workshop or class fairly 
low on most module topics, and their inte.rest fairly high. This suggests that 
* the module topics were worthwhile ones to them. The widest discrepancies 
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'- Participants' Self Rating of Competence and Interest 

Comgetenc^ 







rfe- 


worksho 


D/CTass 




Lnanae"" 


Moll 


Mesa 
Low* 


Verde 
JHi gh* 


drbssmont 
Low , High 


CI 
Low J 


ass 
High 


N 


Grossmont + 
JT/obj ecti ve 


N 


L lass 
X/oWective . 


3 


— 


— 


.76 ' 


.24 


.82 ' 


.16 


6 


.74 


19 


.93 


4 


.90 


.10 


.81 [ 


.19 


• .94 1 


.06 


6 


. .95 


19 


1 .38 " 


5 


.71 


.29 . 


.75 ' 


.25 


.92 ' 


.08 


6 


1 . 00 


19 


1.02 


6 


.49 


.51 


.89 \ 


.11 


.75 \ 


.25 


6 


•77 


19 


1 .05 


7 \ 


.79 


.21 


.82 ' 


.18 




.09 


6 


.54 


19 


1 .51 


8 - 


.80 


.20 


.78 ! 


.22 " 


.86'! 


.14 


5 


.36 


19 


.97 


9 


. 68 


O n 


.64 ' 


.36 


.88(|j 




4 


.00 


19 


1.17 


10 


. /U 




.89 1 


.11 


.95 "1 




5 


.25 


19 


1 .18 


11 


.67 


.33 ' 


. 38 ' 


.62 


.93 ' 


.06 


3 


.17 


19 


1 .27 


1 z 






.21 ! 


.79^ 


.89 ' 


.10 


3 


-.13 


19 


1 .36 








Interest 


♦ 










- 


Mod 


Mesa 
Low 


Verde 
. Hiqh 


lirossmont 
Low , High 


Class 
Low . High 








- 


3 




— 


.18 ' 


.82 


.'37 • 








J. 




4 

•5 


.37 
.23 


.63 
.77 


.^24 \ 
.33 ' 


.76 
.67 


.47 \ 
.33 ' 


.52 










6 


.14 


.85 


.17 ', 


.83 


^ .27 \ 


.73 










7 


.50 


' .50 


,.13^^ 


.87 


.21 ■ 


.79 






« 




8 


.48. 


i -52*' 


.44 1 


.56 


.42 \ 


.58 










9 


. .38 


.62 


.33 ' 


.67 


.34 ■ 


i66. 










10 


.34 


! .66 


.39 


.61 


•32 i 


.68 










11 


.23 


' .77 


.26. ' 


.74 


.34 ■ 


.60 










. 12 








.76 




.72 











* This was rated on a four-point scale. The two bottom points on that 
scale have been combined to form the "low" total, the two top points 

* to forn the "high." 

** 'The data for Mesa Verde were too incomplete to present, i.e., N's of 1 
or 0 i n some cases ... 



+ Numbers in these columns represent the average change ira score for each 
objective in a given module. Thus, for example, participants at Gross- 
mont who took Module 5 rated themsel vesv an average of one full point 
higher on each of the objectives of that module. 
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between these two represent the areas of highest motivation. -The one strong 
variation from this was on .Phase 4 (Modules -11 and 12) at Grossmont, where 
competencies were rated high prior to^the workshop, and gains were low or 
negative. Bi>t in general, participants felt they needed work on the compe- 
tencies presented. 

Students in general rated their abilities lower than practicing guidance 
personnel prior to the workshops, and their interests about, the same, generally 
quite high. The gains they felt they made were generally higher, in some 
cases dramattqa^Tly higher. This suggests that the students represented a 
more appropriate audience for the modules. 

Coordinators at the inservice workshops , were asked to maintain a record 
of how each participant did on each module objective, and provide a plus or 
minus rating to indicate achievement or lack thereof. Since many of the. 
objectives are measured by how well the participant performs on the skill- 
building activities, this s-eemed like the fairest way to determine whether 
participants could do the things expected of them. Problems developed here 
due to Coordinators'' dislike of the "judging" role, the lack of flexibility 
possible in the "grade" (a simple + or -') , and possible variance among 
different Coordinators' judgment. These problems were considered, and this 
+ or = rating system selected. as the least of many "evils 'after considerable 
deliberation. , • • 

Participants' performance as judged by Qoordihators is summarized in 
Table 3. -Individual participant ratings Fielve been added to provide the 
totals for each 'module. The .numbers thus represent "person-objectives," or 
numbers of objectives achieved or not achieved added across all objectives 
and participants. (For example, if a module has f^ve objectives, and six 
participants went through it, there would be 30 such "person-objectives.") 

The main concltrsion suggested by this table is that most participants 
achieved most objectives. Where objectives were not considered .to be achieved, 
in most cases it is because they wej;^. not treated. Exceptions are Module 4 
it Mesa Verde and Modules 6 and 7 at Grossmont. And it should be kept in 
mind that Coordinators' judgment may vary. But in general. Coordinators 
felt that participants were achieving module objectives successfully. 
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TABLE^ J , . . 

Coordinators' Rating of Parti ci |ia.nts ' Achievement of Mojlule Objectives 



Object 



# of 
i ves 



# of Objectives Achieved, Treated but Not Achieved, 
and Not Treated** 



f^dul 

4 
5 
6 
7 
8 
9 

.10 

n 

12 



Achieved 



Meaa Verde 
Treated but 
Not Achieved 



7 

6 

7 

5" 

4 

5 

5 

6 

8 
\ 

6? 



Not 



5 
5 

7 
6 
5 
5 
5 



9 
21 
19 
28 
24 
22 
25 
30. 



Not 



Conducted^ 
11 
3 
9 
0 
0 
3 ' 
0 
0 

Conducted* 



Not 
Treated 



10 

,n 

7 
0 
6 
0 
5. 
10 



N 



Conc'uated, No 



13 
12 
14 
10 
13 
11 
10 
10 



Achieved 



Grosemon 

Treatec^ but 
Not Achfl^ed 



78 
72 
37 
20 
63 
53 
60 
79 



Coniuatedy No 



Data Co^eat^d 

.0 ■ 

14 " 
0 
0 
0 
1 



Data Colleodj^d^ ^^1^' 





*~Modules 1 and 2 were Orientation Modules and lacked the skil^i- 
oriented Jbjectives of 3-12. Thus, these data were not caMected 
for them. ' ^ ^^iiiS 

** '^Not Treated" Objectives resulted from participants having to, l^te 
early. Coordinators choosing to omit parts of modules, and so on. 

+ These gaps were due to Coordinators who failed to fill out the 
forms, at Grossm6nt. Modules 3 and 12 simply were not conducted at 
Mesa Verde, as not enough time was availai)le to do all the modules. 
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The Pavtiaipant Heaatton Form contained a number of items bearing on 
the participants' development of usable skills, as perceived by participants 
.^hemsielves. It specifically samples reactions on: 

• Usefulness of the modules studied, from the individual partici- 
pant's point of view and that of guidance people in general. 

Familiarity with the information presented, and past learning^ex- 
' periences r^elated to it. 

• Gain in skills and specific methods usable in participants* own 
settings. 

Items contained in the instrument also ask for gain in motivation to 
-^•,improve school guidance programs^ unanticipated effects, general criticisms 
or suggestions, and ratings of the Coordinator., These will be reported in 
. the section on the reactions to the experience. 

The data appearing in Table 4 are presented by itemt on the Participant 
Reaction Forrriy across all modules. For -the inservice field tests, the data 
have been grouped across the Mesa Verdie and GrossnX)nt settings, the results 
from the preservice field test are presented in parallel fashion to show 
the comparison. 

* \ 

Table 4 sug^gests a number of cd'iclusions. 

• First, it\strongly suggests that participants felt the modules were 
useful to \them and would be for guidance R^ple in general, in 
t^ms of developing the skills on which they focus. 

• Many participants had had exposure to the topics^j^<?V:iously .: . A 
half of the information was. rated- as familiar, and about two-thirds 

• of the participants had had previous learning experiences in the' 

topics covered. Inservice participants were considerably more ex- 
perienced in this regard than were preservice participants. 

• Most participants (79%) felt the modules helped them acquire and 

practice skills so they are now well prepared to use them in their 

« 

work. Students were a^little less comfortable on this point than, ^ 
practicing professionals. • . '.T 

• Most participants (90%) felt they could use specific methods from the\ 
modules. . . I 
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Module* 3 



J 



1. Vkt are i/ow omill motions to tkU 
mkU fm ijow cm point of 

Hi Imsa of tlie mkU klpd m acquire' 
and praotici'. the ckilk^ on Mch it fomes, 

of^ tk n^Me m useful to m. 

25-431 of the mdule m useful to m. i ■ 

Im iki\ thl of ih wUe m mfil\ tk 
mteml is not relent to fij/ wrk, 

2. Vkt are pur oimll reactions to this mklei 
■. from the point of m of ((uidmoe people in 

qenmV 

At least ?il of tk mMe M help pdrtioi- 
pants acquire and practice the skills m 
tihich it focuseiu 

50-741! of tk rnoiuk dll k useful to thm. 

■ 25-45J of tk mdule dll k useful to tkm. ,. 

' Less thm 252 of the mMe willk useful, 
as tk mterial is not especiallij relemt 
to guidance pro^rims, 

I to Jadliai' m bk infomtion'in this 
mddel » 

lit least 75S of the <Jiateml ms fmiliar to ■ 
im, 

50-74X of the mterial ms f miliar to m, 

2S-45J of the mterial ms fadliar to me, 

Less tkn 25K of pie mteria{ ms fodliai' 
torn. , 



611 



910 



611 



7 10 12 10 
4 



512 



6 

5110 



3i 



3 11 



4 

10 



6 11 



12 



loUls 



61 



22 26 



73 



59 85 
57 77 
26 25 



35 30 
57 52 
40 56 

18 52 



Comb, 



134 
146 



14 



144, 
134 
5] 



65 

109 
96 

70 



.Because Modules ! and 2 were orientation in nature, this information Mas not collected on them. 

'Wnservice setting-Hesa Verde and Grossiont combined. P«Preservice setting-Dr. Gysber's U. of Hissoyri class. 
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Module* 3 



<. k\)& ijou kd prmmdmiing oxpgrUmB in 
the knoiiUiiqe md bHUb oomed in thit 
mdule? 



n 15 12 11 



Ho ' I 

// j^ee, check the tifpee of pwioua Uminge 

Presemce comes through a college i)f 
unimdtii 10 1? 

l/lbrkBhopi( a^\(l/or imemce ^ 

Mding on ^jour m 

* Experience on the job y 1 

i. Oid \}ou feel tkit the mduU helped ijou (Wh. 
quire and practice bHUb bo thai ^ou are w . 
well prepared to use thm in ijour ]X)rk? 



So 



ff. Could ijou m specific mthode fraii this 
wdule to throve guidance, oounseling, place 
mnt, oM/ov folloith through progrm in |/our 
school Betting? ' 

Ho 



1^ 16 11 



'8 



5* 



121H610 



12 18 iei7IH8 18 15 



8 

315 



16 18 18 16 16 15 



91310 



10 



12 



Totals 



Comb. 



13 



8 12 12 



912 



12 



211 



310 



311 



11(10! 
34 84 



65 68 
57 26 
57 24 
94 30 



223 
118 



133 
83 

I 



1612 12 



9P2 
7 



6 



8 



12514J 
24 48 



7181517 



269 
72 



3 



2 



3!16( 
10 22 



307 
32 



'J 



ft 

(■) 



ERIC 



I 



3,9 



Because the Grossmont field test was so ^nuch more ^substantial tH|an the 
Mesa Vorde one in term^ of numbers of part icjipantsgi and amount of^JJme asked 
of participants, a follov?-up data collection was conducted there two months 
following the^ workshops to gauge effects that occurred during that time. 
Thirty-seven of the original group of 47 participants were reached in this 
effort. The remaining ten were unavailable due to transfers or conflicting 
schedules. This follow-up involved two- types of measures: 1) short-answer 
tests on the modules an individual studied; and 2) e^n interview with each 
participant, using a structured interview form which focused on: 

• Progress over the two months on plans developed at the workshops. 

• Positive and negative changes h'n programs resulting from the workshops. 
§ New planning as a result of the workshop. 

The form also gathered information ort suggestions for improvemeats in the 
workshops, side effects, and general reactions. These will be reported in 
the section on reactions to the experience. 

The short-answer test was also administered to the college class, at 
the end of the quarter, for all modules. The follow-up intervi-ew seemed 
inadvisable, since these participants had no setting in which they were work-* 
ing to gauge the practical effects of the experience. The results of the 
test in both Grossmont and in the class are- summari zed in Table 5. Table 6 
summarizes the results of the two-month fallow-up interviews at Grossmont. 

Three conclusions seem apparent from Table 5. . 

• No one in either setting did consistently well. This suggests a 
weakness in the test. It measured just knowledge, while the modules' 
main thrust was toward skills,. and this may account for much of this 
problem. ^ 

• Students generally did betteV than working professionals. This may 
reflect the-jr general test-taking ski 1 1 thei r chance to study which 
inservic^ participants were not afforded, or a genuinely greater 
knowledge^^f the modules' content. 

• Lack of any response was a problem at Grossmont which- was absent 
Jn the class. This reflects the "captive audience.;^ nature of the 
bOass. It also may 'reflect a greater degree of resentment and resistance 
both toward the test and the workshop experience on the part of the 
Qrossmont Participants. 

Table 6 applies just to Grossmont. It suggests several concl lisions. 

^ 30 ^ 

40 



• Only 40% of the participants wrote up plans for applying the module 
skills to their school setting. 

• Forty-four percent of the participants felt t^ir school program 
had improved as a result of the workshops. Forty-seven percent felt 
it had not. 

• Thirty percent of participants felt there were negative effects 
of the workshops^ 62% did not feel this.' 

t Plans made in the workshop had been followed to varying degrees, 
suggesting no clear pattern of use or disuse. ^ 

• Fifty-foUr percent of participants had developed additional plans 
since th^ workshops, suggesting increased activity in this direction 
as a result of the workshops. 
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TABLE 6 ..'s 
(continued on next 'page) 

Followup Interviews - Grossmont 



1. For each module, or set of modules, you completed in October, you were 
asked to outli,ne a plan for applying to your own school setting the 
skills you developed *and/or practiced in the workshops. 



Did 



Did 



you write up 
(i ) for each 
(ii) for each 



a plan, 
modujie? 

set of modules? 



you think about a plan but not write 
(i) for each module? 
(ii) for each set of modules? 



yes 

a% 

32% 

it up, 
0% 
19% 



no 



57% i 
54% ' t 



38% 
32% 



■"Is there any aspect of your workshop planning not considered by the 
above questions? If so, please summarize it: 

Two people (5%) answered dffivmatively^ and eight others (22%) 
offered some explanation for the lack of planning they had done. 



The purpose of the workshops was to help participants develop practical 
skills that they could then use to improve guidance, counseling, place- 
ment, and follow-through programs in their school settings. We' assumed 
that by encouraging participants, to formulate personal and team action 
plans for their schools, the workshops would have more practical relevance 
to their needs. Please explain why you didn't become involved in* this . 
planning activity. [This item was designed only for those individuals who 
had not responded to item 1.] * - 

• 23% of participants provided such explanations here. 



During the two months since the workshops, have you personally experienced 
any improvements or participated in improving programs at your school -that 
you believe were direct results of tRe workshops^ , 

Yes. 44% 
No 47% 
No response 9% 

a. Please describe what you feel was the most valuable result. \' 
(i ) What happened? 

All 16 participants Dho answered affirmatively 
were able to provide, at least one example. In ally 
43 examples were provided^ or an average of 2,7 per 
affirmative response. 



Where percentages do not total 100, certain forms lacked any response. 



Table 6y continued 



During that same time period, were there resul^ts that were not positive 
but yet were direct effects of the workshops?; 

Yes 30% - . ' ' 

.. No 62% ■ / 

No response 8% 

Please describe each negative (or neutral) result. First, let's 
take the one that stands out most in your mind. ' 
(i) What Jiappened? 

All 11 partiaipants whd answered affirmatively were 
able to provide at least one example. In all, 26 
examples were provided, or an average If 1.5 per 
I dffirmative responseJ 



a. 



Wring the last two months, to what /degree have you been able to follow 
the plan(s) you made in the worksho,i)s for this time period? 

^ ■ ■ ■ ■ / ■ , '.Q ■ ■ 
Implemented at least 75% of wl;'at was planned 16% 
' Implemented 50-74% of what wa^ planned 9^ 

Implemented 25-49% of what was planned , * ooJ 
Implemented less than 25% of what was planned 28% • 

No response -. y » 41% . 

DuriTig the last two months, a,^ a result of the workshop have you developed 
additional (or new) plans to/improve guidance, counseling, placement, and 
.follow-through programs in ^bur school setting? 

Yes . 54% / ' 

* „ No 41% / • • ^ 

No response. , 5% ^/ , ■ 

a. If so, have we alre/dy summarized such planning earlier during this 
interview? / 

Yes ' 8% / 

'N,o< ■ 35%/ 

No response 57^' 

b. ^ Please summarise your additional (or new) plan(s). 

' Nineteen participants (52%) provided examples of new plaits 
they hadlmade. 

■ I 

/ . . 

~ "7 ■ 
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Impact - ReactiSns. to the Experience \ . ^ 

While some of the i nformati on provided in the previous section touches 
on reactions to the workshop and classroom exper"|ence, i ^primarily deals 
with the. results of those experiences in terms of measurable gains in 
knowledge, skills, and program improvement . Cert^i n items on the 1 ) Partici- 
pant. Reaction Form and 2) Followup Ihtervieio F^cprm, sampl e reactions more 
in terms of attitudes and feelings. In addition, |3) feedback received 
through more informal channels, through the debri%ings in the workshops and 
final class discussion, provides useful informatiop of this sort. These 
three categories of information will be summari zed|herG. ^4 

The first six items on the Participant ReactiO(n Form^ responses to 
^whi;:h'*are summarized in Table 4 in the previous sec^tion, all have a partial' 
slant toward feelings and attitudes'. Overall reaction to the workshops, 
past related experience, and increase in usable skills are all touched on 
there. A review of the responses presented in that section might be useful 
at this point. The third category, increase in usable skills, is covered in 
Jtems 5-6, which also ask for ex^mp^es to support thd^ given responses. Item 
7 samples desire tc .improve programs, item 8 asks for-^ unanticipated effects 
(positive or negative) and item 9 asks for cri ti ci sms ^^of the module and 
suggestions for improving it. All the comments from these five items are .. 
summarized in Digest 1. Because of its length and detail, this digest is 
contained in the Appendix. . 

The way information from comments made on these five items is 
summarized is as follows: ^ 

• Fir'st, by item. Thus, al 1 ..comments made in response to item 5 
are group, followed b^^cpmments from item 6, and so on. 

• Within each item, comments aV:^djv^ded: among the three settings 

• in which they were gathered: Mesa Verde, Grossmor^t, and Dr. Gysbers' 
class.. \ 

• Within a given , setting, comments are listed by modlle, beginning 
/With Module '3 and ending with Module 12. 1 ' 

Thus comments are included for every module studied at eachl of the three 
settings, for all five items-. Each comment has been editedito the bare 
message, and reference to specific individuals bas been edited out. In 
addition, the'yes~no response totals are given for items 5-8. Item 9 is 

open-ended. ^ . . 1 / . 

\ / 
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/ It is almost impossible to provide a useful summary of this digest. It 
is 31 pages long, and contains hundredis of individua4^)camples and insights. 
ThesB fall into the five categories defined by the items, namely: • 
/ Skills acquired 

■ • Methods^ useful at participants' own settings 



/ 



/ m rietnuas Uberui dt par l i l i pan tb uwn bettiriy:> i • 

• Improved desire -for program improvement 

• Unanticipated effects • 
•\General, criticisms and suggestions 

The majority of these examples are positive or neutral (simple examples of 
skills or methods), reflecting the positive yes-rib tallies to the questions. 
The last two items reflect a more negative response, particularly the last, 
thj^s^is^^ ogical , as this item asks for criticisms. 

A general difficulty that occurred with preparing all three digests 
was the brevity arnif^r fragmentation of many of the remarks. While many of 
the least understandable comments have been edited out, some remain. Thus 
where the reader feels a frustration in making sense of certain comments, this 
was a frustration shared by the editor, not caused by her. This may represent 
3 cornment in itself, suggestirig something about either the' ability or moti- 
vation of tfle participants. 

. i ' 

The follow-up iitterview was conducted just at Grossmont". As reported^ 
in the last sec^r^, it focused on the implementation of plans developed at 
the workshop r^^positive and negative impact of the workshops, and additional 
planning activities carried out since the workshops. Three items on this 
form provoked largely feeling reactions to the experience. Item 5 asks for 
ways the workshop planning could have been more effective, item 7 for - 
unanticipated .side effects (positive or negative) of the workshops, and . 
item 8 for final comments and suggestions. . . 

Information from these items are summarized by item. Each indi- 
vidual's comments have been edited down to the essential message, and names 
of individuals have been edi ted out. Each paragraph represents one indivi- 
.dual's comments. Thj^ questions are presented first, along with results of 
the yes-no rating preceding the comments for items 5 and 7. 

Again, it is very difficult to provide a useful summary of the many 
comments presented in Digest 2. They do fall into the categories suggested 
by the questions: * 

• Ways in which the workshops could have been better planned and conducted 
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• Unanticipated -effects of the workshops 

t General coraments and ''suggestions * , . 

the majority of the»comments in the first category are critical, quite 
logically. Those in the. second and th'ird categories are a mixture of 
positive and negative. They gener'ally reflect the pragmatic orientation 
of the participants and their concern about what practical achievements 
^v^T^be made as a restjl't of the workshops . The only way to gain a real 
understanding of the fee?lback i*s to read through the responses themselves. 



. _ DIGE6T 2 

■ ' ' , ■ •■ ^ 

^ Follow-up Interview 

5. (a) Is theve any way(s) your workshop planning could have been more 
effective?* - * 

Yes 56% ■ ' . ■ - . . ' 

No 19% ^ ■ ' 

(b) If so J in what way(s) ^and how could we have helped? 

\ . ■ 

Doesn' t "think it helped. Too much autonomy in district; counselors 
resist change. 

Things beginning to happen- slowly'^but need to get over resistance. 
Too long. One good coordinator. Cu£ down module. Only used activities 
meaningful to counselors. Too much time. One coordinator very inflexible- 
bad reaction. Module 10 had little continuity. with Modul'es 8 and 9. 

Make it more specific. Wri te^objectives moi?e in line with what one 
could actually do. Less abstract." 

Too much flexibility: Helped get all sorts of- skills. Group leaders-- 
freedom of choice, uncomfortable with material. Choices not made on 
basis of group needs. Bad to skip parts of modules. Felt that research 
went into package. Bad with state department people leading modules; 
not -that knowledgeable jn area, more political, socj^aJ . 

Too much time on things already done. Could have been done quicker, 
simplified. Vocabulary ambfguous; redundancy. Paper pushing. 

*Less than 100"/ totals was duetto interviewer lapses in recording the yes-no 
•responses, not respondent failures to reply. 
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Digept 2, continued 



m 



Two groups in one room bad--breaks concentration. Noise^ bad facilities. 
Suggests reading outside of class. Various reading speeds, ^chaotic. Skipped 
things. 

/Should have answered needs of participants. Imposed. Should condense 
materials to use less time. Give out ahead of time. Spent tdo much 
time reading. 

Stay out of tough political situations.. These made it hard to judge 
materials on own. Give out materials ahead of time. 

Workshops should be shorter so school responsibilities don't lapse. 
Sh'ould actually produce instruments/products participants could use. 



'Nothing practi cal ^from Orientation— a li^ttle terminology. Needed^HH 
evaluation workshop in a-Tl areas. Coordination among staff not too 
helpful. Much repetition; too basic, a Vehash'. Coordinator rambled. 
Too long. • ^ » 

Coordinators inadequate. Too long. Lack: of understanding of profes- 
sional level of participants. Coordinator talked down to by people with 
more experience and expertise. Coordinators put ^ieople off. 

Workshops didn't relate to needs. District-wide definition bad— 
too many variations. ' %. ' 

Too easy reading. Liked cartoons. Groups OK. Preplanning and Orienta- 
tion bad. Hos,;tility before started. 

Anything relating to Master Plan (MP) and district personnel baa. 

Shorter sessions. Time wasted. Should do homework at night. 
Implication that what people^are doing now is "all wrong" is bad, turns 
people off. My school is an example--worked hard last year and got no 
credit. Deal first with pri nci pal s— they were in the dark, felt that 
they'd been had. 

I needed to attend more modules. Vocabulary was bad. Jargon a 
problem. Principals and vice pri nci pal 9^ need to be sold on it before 
MP written, not aft^r. We feared this was going to be. imposed by district 
guidance director; school losing autonomy. 

Space sections out, have people produce things. Situations were 
contrived. Timing was bad. Should have dovetailed MP and AIR's package 
more effectively. MP will lay down and die. New superi ntendent. i n favor 
of local autonomy; this is good. No understanding of local operations 
by district guidance personnel. . ' 




Gould have been done quicker. 



Not'mUch opportunity to work on "strategies" a^rea.' 
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Dige^jt- 2, continued ' ' • 

* ^ ' ■ ■ ' ' . ^ 

Duringrthe last two months^ have you experienced any unanticipated effects 
JpOsitive or negative) of the workshops — ones that you haven't described 
J%lrekLdy? ^ ^.£fe^>* 

Yes 495^ 
Ne 43% 



If sOy please describe them. 

Resentment against district guidance personnel. They imposed things 
we didn't want. This should have been voluntary. 

Frustration. Meeting time required. Thrashing through what to do. 

Professional contacts with other counselors were good. Easier to get 
information from other schools. Got less than hoped for from workshops. 
• Negative reinforcement. 

Better understanding of goals and objectives helpingnn school planning 
process. Not too active yet. 

Contact with other district counselors. Lost time on job. Frustration 
level up. 

Pursuing affective reading. -Enthused'-this approach doesn't have to 
be complicated. 

Crystallized idea of outcomes. Some material ;:good. Increased 
vocabulary to impress people. 

Increased load. Created frustration. 

Not enough time for everything. 

Contact with other personnel was good. Lost time on job, which created 
problems with students. . ^ * 

No time to do anything along lines learned in workshop. No follow- 
through--no*one at my school to establish priorities and take leadership. 

Concern on counseling staff ' s' bei ng behind o^ibher schools in accomplish- 
ing organized planning. 

Attemj)ted to change counseling priorities to focus more on vocational 
needs^.of students. No clearcut impact of workshop^ 

Interaction among people positive. Solidified negative feelings on 
district implementation and developing career guidance programs. 

Animosity -joined people together. Learned some good restaurants. 

Leary of district-inservice. 5 
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Digest 2j continued 

« 

More invQlved in career education and planning.. 

Frustration resulted in -district personnel -staying away from schools 
altogether. ^ ^ 

We*re talking about redesigning facilities. Renewed comnitment to 
career development. 



8. Thank you for participating in the workshops, and agreeing to help us with 
this follow-up. Please l^t us know if we can provide any assistance to you 
. in the future. Are there any final comments vr suggestions you care to 
make? ' ^- 

Feels school administrative resistance to type of planning discussed 
in workshops and Set out in district'plan. Meetings not productive 
enough. Enjoyed workshops immenselyr-scientif ic njethod of doing things, 
get away from in school (assessing student). Personal pain and frustra- 
tion due to counseling department decisions and reversals. - 

Philosophical difference a problem in the counseling department. Much 
resistance. Group not much of a team. Feels more qualified due to work- 
shop but can'Kdo it alone. Positive about workshop but needed more time 
on practical art^lications and less on philosophical, issues. - 

Bewildered. Workshop very helpful, leader patient. Doesn't feel as 
competent in planning and career development. Too much asked of counselors 
Frustrated being away from office and students. Felt positive about work- 
shops. 

Staff not a team, argue a lot'. Frustrating. People dragging heels. 
Shortage of money limits what can be done. No time tradeoffs. Need 
encouragement. ' • 

We now plan more precisely what will happen in class units related to 
. guidSttce. Get into classrooms more. Will be responsible fo;^ classroom 

^ evaluation. Skills aren't that developed yet. Need more reality exposure. 

Some materials good. Action verbs in Module 6 good. Few materials 
practical like t;his. Need tp see cost effectiveness at work. Negative 
feelings toward district guidance personnel. Wdn*t alv/ays be there 
while counselors will. Reaction form futile. Follow-up knowledge test was 
Mickey Mouse. Cynical feelings toward experience.^ .* 

pia?ming time is time aw^iy from students; however, feel positive about 
workshops. ' ' 

Beneficial'' but piecemeal handling of Phase 1. Backlog of counselors, 
recommend evenings or weekends. 

Felt out of it (new to school). ? . ^ . 
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Digest 2^ continued " 

Not enough time. Impressed with leaders' fielding of questions. Drop- 
in youth center, family counseling centers, truancy prevent! oa«; is over and 
abovetjob. 

Materials good, weljwr^tten. Relevant to" decision making. Wants to 
see final report. Resents MP--not directed to student outcomes. 



Idea great, 
use materials. 



Bad timing.. Modules good. Nice informed outlook. 
Problem kids will destroy, any system. 



How to 



Orientatjon bad, 



Hostilities'. 



No basis to judge program involvement. 
Not very productive. 

Gained personally; no real program improvement. Basic idea good. 
Frustration. Negative toward MP; don't need. Workshops showed how it 
developed, lent more respect for it even if it is impractical. 

Leaders likeable but low key. Not sufficiently task-oriented. Modules 
could have been covered more quickly. [Not negative] Could have covered 
material more effecti vely. , ^ValuSbl e; will help implement school plan more 
effectively. . . 

•Came in hostile, now more willing to promote changes. Workshops helped 
me to see what I should be doing and what I wanted to do. Will be more 
impact in 3 months; come back then. Training we received was needed, 
Better direction to go in. 

Positive about planning process. Concern with accomplishing goals. 
Problem^of priorities and getting time to meet them. 

One coordinator was good--another was disappointing, not as well 
organized. Not an intellectual type so didn't get into planning as easily 
From business world, not education. 

More district participation needed instead of outsiders. Workshops 
intellectual to point of being stuffy; should have been more down-to-earth 
Not well organized enough to get teams, worki ng and planning together. 
Haven't done it since. 

Lack of support for change and/or eval uation--np one to give ideas to. , 
'Administration hostile to MP. .Apathetic. Exercise in futility. Low 
priority on accountability. Apathy in counseling. Should have gone 
through one complete example for each phase, More attention on getting 
administrative support for planning needed. Should involve teachers. 
Conflict exists between school and district administration on presentation 
of MP. It was forced on us. ' _ " 

• Too intellectual. More time and exposure needed. Haven't used any 
materials yet, but when need to plan, will have materia.ls to do so. 

Part of workshop too intellectually draining. Not enough time. 
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Positive about impact. Some basic ideas, doing some planning. Didn't 
like the way district organized workshop and planning. Like to see another 
follow-up on a weekend. 

" . ■ i . 

Stress on behavioral objectives can be a semantic exercise. Didn't 
understand how workshops fitted into MP. Ordered to go. Bad. timing. 
Hostility interfered. Examples and exercises insulting, not practical. 
Some. discussions effective but role hasn't changed due to it. 

Resistance and hostility from counselors. Forced to go. Timing bad 
(Not air's fault). Felt if I didn't do anytfiing, MP would go away. Learned 
to write performance objectives but haven't used them yet. Felt good about 
training. 

Too fragmented; should have been exposed to all modules. Needed more 
time. Forced to go. No one treated me as an expert on Modules 11 and 12. . 

Got people moving. Workshop pace too slow.. Should have capitalized' 
more on counselor's knowledge. Should have been voluntary. Lack of 
teamwork follow-through after workshop. Could have started with school's 
needs assessment data and then considered information in modules. 

4 * 

Profited from interaction with coordinator from state department. 
Modules could have befen done in a shorter period of time. Time wasted. 
Can't do both team planning recommended and regular tasks. 

No noticeable influence of v/orkshops. Guidance programs I'm writing 
have no relationship to workshops. Workshops should have been a result 
of our needs. Forced to go. Di strict <|uidance personnel don't lii$ten. 
State department personnel not involved t.n schj0orco^selir>g. 

Negative feelings toward test and vJll'kshops . Negative feelings ahead 
of time due to experience with TALENT (AIR project) . Resistance to district 
personnel. Counselors can do planning. Don't need AIR. 

Needed more information in advance about purpose of workshop. Negativ^ 
feelings toward whole attempt. Instructors nice people but not for train- 
ing professionals; were dull. 

Plan already developed. Workshop too late, but gradual enthusiasm. 
New administration stifling, frustrating; no time. Workin'Q with other 
schools not helpful. Using AIR materials instead of MP. This wrong. 
Unfortunate that Department Chairman didn't attend (due to previous committ- 
ment).. Had some hostility toward "one coordinator. Another was great. • 
District's plan incorporated nothing of our new school's plan... Acting 
as if nothing happened. Like coordinator .to return to get things off ,^ 
tne ground. Career center and'help at our school .is, good. 

■ • . ' « 

Need for simple English. "Subset optimization" is ridiculous; turned 
people off. If approach simple and clear, will be good and vital. 

Materials ^don't deal with present inability to obtain jobs. Different 
work ethic withJOwer classes, high unemployment. Neat ideas but impractical 
Hostile toward one person, nqt AIR; felt sorry for AIR. 



Digest 2j continued 

Subject matter good. Presepted badly,. ..^instructors OK. Bad situation-- 
irtiposition of MP. • ' . 

District transiency very high-problem for career counseling. Shpujd 
have been briefed in advance of workshops. Bad political situation,* resent 
central authority. More AIR investigation of local school r^ds needed 
before delivering programs. 



While the reactions that have been sunmarized from the Participant 
Reaction Form and. FolloD-up Interview, Form are quite extensive and detailed, 
the impressions one leaves a^jiworkshop or class with are u-sually formed from 
more informal and random comments' Debriefing sessions of one to two hours, 
following the workshops, were held at both Mesa Verde and Grossmont, and a ^ ' 
central function'^of these was to gather participants' immediate reactions^ to . 
the experience. Similarly, a class discussion at the end of the quarter in 
Dr. Gysbers' class allowed for general reactions to the modules and the 

1earnir.g experienc ev- While comments r eceived in t 4^ese^nums-jn ust be ^ — , — 

N considered data of a Jess rigorous and^r.itrustworthy nature, they do form a 
body of information^worth including. ^ 

^hese comments are presented for ea^ of the three settings. They 
have^^n edited down to their essential, message, and references to specific 
individuals have been edited out. . 

The comments are generally negative in tone in the two inservice settings, 
anji in some cases hostile. Partly tHts is a natural reaction to being asked 
for reactions and criticisms at the end of an experience. The human mind 
naturally focuses on problems and possible improvements. More than that, 
however, it proved a venting experience for participants' dissatisfactions 
and frustration. |some felt they had had little say in their participation, 
and that what they had gained had not justified the time away from the job. 
It is probably the case that those mOst frustrated and hostile were m^^st 
vocal in these debriefings. Inservice pairtici pants were far more positive in 
their reactions, although they also cite certain frustrations and dissatis- 
factions. Again, the only way to gain a real sense of these reactions in any 
of the settings is to read through the individual comments themselves. 
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Digest 3 



Reactions Reported During Debriefing Sessions 



Mesa Verde 

. "■' i-,> 

The content was too basic for this group. The concepts are at a high ^ 
school level in many cases, and these are largely well-educated people in 
this area. 

When asked how many in tie group had taken away something new they could 
Sictually use in their job, about half raised their hands. 

It was suggested that the modules are more useful as a resource to turn 
to than as an educational vehicle. ' t 

It was suggested that the modules would be more useful if they required 
the actual production of the end products in question (a needs-assessment 
instrument, perforwance objectives, an evaluation instrument) as people worked 
through them. S^mplyM earni ng the process or how to do this seemed trivial. 

Little real in-depth knowledge was actually presented, once one v/aded 
through the jargon artd figured out wfiat was actually being talked about. 

The modules would be mbne useful if fhey related the process they 
about more directly to a practttidner's problems. r-. . 

•' " < ' ■ 

' There- was nothing new in the modules--and some of the old was made 
coifi fusing. ' , 

\ "If anyone in charge of a program doesn't^know what*s in those books, 
they're in trouble. 'MayjDe they would help someone starting, out at ground^ 
zer^, but they're too basic for anyone who will be- in a responsible position." 

\The program might be OK as a refresher or resource. 

\It's presumptuous to suggest better planning and evaluation as an 
'answe^ to problems , 'when those in the field are pointing to everything but 
this as the problem.' When specific problems are pointed to (like drugs, or 
the need for better career education) it means we need help with those, not 
that tf\e whole program is falling apart. Who are they. anyway, to tell us 
better planning is the answer? 

We make a.n assumption that those in the field can't do these things. .. 
They may not be doing them, but it's not because they don*t know how, it'^ 
because tbey lack the time and resources. 

V ' ' » ■ 

The surmiative evaluation module talks about needing to make. hard judg- 
ments and eliminate ineffective programs. While this program has redeeming 
features, so does anything, including a pile of dog shit (sic). Let's not 
be so damn *ge;nerous. This is bad. 
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Diijest t^, . continued^ 



The evaluation instruments only allowed for extreme responses at the 
end of the continuum (minimally competent, very competent; Coordinator was 
pairtially helpful and partially a hindrance) or grouped two or three questid)n 
together with only one response possible. ('Did you have a chance to acquijhe 
and practice. . . ' ) , / 



50 to 75% 



You can't estimate your . responses in precise percentages, like 'from 



"I never really got a chance to evaluate the module, to say, 'This 
module taught me nothing.' It took me lower than:I already was." 

A-A nIi'"^*^^^ ^^""^ pressed for filling out the evaluation instruments.' Why 

}■ 5 project with no money to pay participants for field testing? 

What Kind of pl^anmng and evaluation design is that? 

We expected help in doing a better, job on career education in the ^' 
school. The modules had no relationship to our needs. 

' We preach assessing needs, but no assessment of participants' needl* was 
done, even within a given module. In many cases we were asked to spend end- 
less hours on things we already knew. 

We never got a clear overview of how all of the modules fit together. 
I still don' t understand. 

The modules don't meet our needs at all. ^Why weren't these sampled 
first? ^ 

The terminology was different and difficult, .process and performance 
objectives are confusing. There seemed to be varia'^nce in use of language 
between modules (this turned out to be because of the confusion between per- 
formance and process objectives). 

The language was too research oriented, full of oblique terms, circum- 
locution, excess verbiage. 

Embedded clauses were common. This makes for 'hard reading. 

"Give us just the summaries. .You're trying to make ten books out of one." 

In most cases the concepts were simple, but we use different 'terms for 
them. Often we were being asked to use new labels for things we already knew, 
and this was the only learning going on: 

In some cases coordinators were ill-prepared, were just a jump ahead of 
the^ group. "I resented spending time with' an ill-prepared coordinator." 
(This was contradicted by some als'o.) 

Have the coordinators summarize more of the information, eliminate much 
of the reading. 
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Digest 3j continued 



Grossmont 

You gave us "pie in the sky" at the beginning. You promised totfmuch. 
We needed to know more of the limitations and constraints. Working in the 
real world is very frustrating. 

We arrived the first Jay already hostile. We were pushed here, scheduled 
without our choice. We had no say in whether a Master Plan would be developed 

Local school administrators are the key to this working. We needed to 
•kngw thfey were conmitted to it before we started. 

"I feel like we threw away a lot of hours without knowing what happened." 

The workshop -would be better in the summer. It's hard to take time from 
school . ^ - 

The Master Plan is too big and. complicated. All the instruction related 
to it. The hostilities to the first transferred to the second. 

The inservice should have come before development of the Master Plan, or 
the two should have happened simultaneously. 

The approach is scientific and sound. It's better than flying by the 
seat of your pants^ which is what we're doing now. It's not new, however. 
It*s what common; a.e|l»i^!^ictates. 

Modules 8-10 (Phase 3) are simplistic to the point-.bf being ridiculous. 
Parts of them are badly done, particularly in Module 10. 

The vocabulary was bad. The concepts are sirrfpfe, so why not use simple 
terms. Educators have> gotten so they reject "edMca^tionalese" out-of-hand. 
'Outcomes,' student performance objectives, subsfet optimization' sound 
absurd--they just turn- people off. 

Too much time was allowed. Half-day workshops would'have' been sufficient, 
and better. . ■ 

Every participant should have received a complete set of their- own monies 

The modules talk down. We were asked to gauge our competence beforq we . 
began, without guidelines. We already are as competent as the modules .demand. , 
(Comment from woman in Phase 3.) - 'l- 

- The self-assessment of competence scale allowed no medium point. It gpes^ 
from 'minimally competent' to 'very competent.'- "'""'^'^ 

The module on objectives was excellent. I learned useful, practical 
skills in a way that made clear what had been fuzzy before. 

The leaders often seemed unfamiliar with the materials. Were they 
given any training? 
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The exercises were repetitive. We n&eded one that would ir\clude all 
the ski 1 Is , • 

School District or schools receiving the i nservice must coordinate 
agendas with the State or AIR-- there seemed to be two di fferent agendas one 
from AIR and one from Grossmont. ' ^ \ ' 

Materials were heavy with verbiage. Many cornmon words were used in 
an uncommon sense. Example--the many uses of the term "environment.'' "Sub- 
set optimization?" 

Format of modules should^jDe designed to be read separately from the 

-activities^ Thus they could^8^eri<i' hand^' of parti ci pants before workshop. 

.There was not enough t ime'' to;^ rgad and int'erhaVi26 • the materials in the work- 
shop. ' >^ ^ ^ ' :^ \ ^ 

JWe must be -made aware that all ouftomes of these; modules will reflect 



r^'ljie .^inconsistencies" of tf^e "co(5rdi na€ors. 

^ Coordinators for. the^mqst part wer^. compete^ '^and helpful faci litators. 
^'^pwexer, they appeared to'^be .ynfami liar with the materials^ih sorrie instances. 



t-k- »^'The orientation could be shQrter--reduce to halfyJay 



"A 



Orientaftio,rr--'cf'epepli^iilig where^S' school or distrtj^V \s in their planning 
/"proness an oppartuni ty'shQuld be^^i ven for .-th'e parti c1 paints to vent hostility. 
<y A general feel'ir^g w^^^ expifessed/^atf tlni s was one of the .r^sg\ts of the 
''. orientation.) . ' \^ v - - . ' . . ' * 



Tlife greatest-.^problem-v^agree^ upon*-^hy consensus of the gi^oup--was that 
;eventy|f ive. per/ent of vthe distrTct 'plan Was not generated or planned by 
the guiyoance p^Qnnel vat .it1i.e school levels bdt was laid tipon them. 
' \ p • '^'^"^ . * ' ^ ^ ' • ^ 

precis §otii^*doubt ,as tp" the. quantity aind qua 1 i ty gained 
f rote r.t^se modal es.;- > . j . ' . " . /' ?t ' 

V Jhere need^ ' to'^e some v^ystenrto^^expl aj n ^^eg^h phdse*- and- each module 
(skill cdntent) befjjra qrieht^tiop ari^j before the selection process. 

Explain in advance ^hat^the partii^ipanrcs wi gety oqt of it--how it 

•V KelateSi to.-tt^eir program N(e.?. ,-Master^^Pl,an) . ^ ■ 

• ■ - •■ ' ^ ^ : ^ '--.^ 

^*how skills 'atre. necessary* for; mefihtai nirig .programs as well as 



/or C£e5(t^ ^lpg^tt>eRii 




'^"toriehtation should be an orientation (it^.wasn't). What the modules* 
corvtaj/i' sh.ould>b€ known before orientationMp'^iV^ted' page or two). Spend 
rnfnirnum amoujnt of time on exp^aining^modules. . Get jrrght into the process, 
worktng thraugh the first tWo .njoduTes. •"' ^^. ''...y • . 



Dw to avt 



Selecil5>ons were made orf'^avenience ratherv than, i nterest--don' t know 
to avi^y thi s . • ) ^i--: } ' 
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•^->i(jcst 3y continued 

J Suggestion: VP take all modules to get' overview and furnish articulation. 
Irjidividual counselors take a few modules on which they become the resident 
experts. Some said 11 & 12 could be done in one^day; others said they needed 
three days. Suggestion: Do 8, 9, and 10 in two days--use third day to put 
it all together in terms of local program. 

Too much jargbn--especially 10 and 11. 

References to earlier modules (which participant hasn't covered) is 
confusing and frustrating. 

Use whole package; disadvantage if you haven't covered earlier mpdules. 

Workshops should be in summer; if in school year, should be in November 
or April . 

^ ,* > ' 

Reduce theoretical emphasis--get down to how it really applies in a ' 
,real-l ife school . ^ 



^ Modules 6 and 7 use foreign 1 anguage--you need too much time determining 
meaning of terms. 

Address each module with a quick gestalt, then identify some practical 
concerns and address them by following the process through steff by step. ■ 
The activities (some) are unreal--lack relevance. 

Modules "would have to be rewritten to be self-instructional. Suggestions: 
Cover two modules in one day--*second day, apply it, train VP's to go back 
and work with their staff on a continuing basis, instead of training Indians 
who will forget muqh of it before they get to implementation. 

Use' overheads for definitions, etc. at beginning of module and for a 
checklist at end of module (or chapter) to review what was covered. Should 
train administrators and teachers. 

Best to have a team from a school, Including teachers and administrators. 

(Facilitators:) 

Personable, but some didn't know the materials well enough--couldn ' t 
answer questions — lacked expertise. 

Some facilitators didn't really help with content, though they were 
good group leaders. , 

Need the same facilitator for a full phase; lost time bringing second 
facilitator up to where they were. 

Need to give more and better examples. 
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Digest 3^ continued 



Dr. Gysbers' Class 



The nuts-and-bolts approach is good. Things are broken dUn into steps 
and activities. This is good. - r 

. ' i 

Both the content and process of the modules is^usef ul ; ^tli^y have a 
practical outlook. <^ < j\ 1 

\ \ ■ '1 

It's a little hard to maintain interest throughout. They bre kind of 7 
huge thing. But it's a useful process. [ 

There are things anyone can take, and use. The needs assessWnt approach 
^ tn Module 3 is an example. i \ 

Some of the activities are not real practical. /\ 

The modules did provide a practical sense of what a gtiidancelprogram is. 

They give a good overview of some of the changes that need to happen in 
guidance. • ' 



I'm not iure the moiJljles will produce change. agents . They witl produce 
people sympathetic to the process, but not 'necessari ly leaders of it. (Others 
in the class disagreed with this.) ^ ^ 

It is not imposs9b^e to carry out such a process. | 

I like the accountability idea, measuring accomplishments in concrete 
ways. This would be effective in talking to administrators. 1 

I'm impressed by the amount o4 work required for any change, it's ^ 
very detailed process. \ 

^ \ 

The modules make you look at J:hings realistically. \ 

' V ' ^ ^ 

There is too much emphasis ih career counseling at the expense ofi personal 

counseling and self development in the modules.' - 1 

I need a summary--a condensation--to tie all the bits together belter. 
One book with 12 chapters. (Others expressed a liking for the module ^prmat.) 

^We'd like the materials to be made more generally available. 



The terms are tough. Even among various groups in guidance they vaVy. 
I need a more specific time line for how this whole process would work. 1 " 

\ i 

Need more of feel for inservic^e settings when done in college class. \ •/ 
Questions on postassessments not tfeati ve—just regurgitations of what's in/ 
module; no combine/contrast. ; - W 



Influencing Factors 

The ideal field test would be one in which the only significant un- 
controlled variable was the one under study. In this case that would be the 
impact of the m/?dules ^nd workshops on the participants and their programs. 
Unfortunately , ipure tests are hard to. come by. This was a particular 
problem in this case. 

The kinds C^variables affecting the impact of the field tests were 
many, but a few stand out*^ Four will be discussed here: 

• The Coordinators of the inodules 

t The facilities in which the workshops were held 

• The scheduling of the workshops 

• Factors in .the settings affecting participants''' attitudes 

It seemed clear from the start that the quality of workshop leadership 
available to go along with the materials would bft -crucial. We therefore 
decided to collect related information of two type^s: Coordinators' Peelings 
about the participants, and participants* feelings abou"t the Coordinators. 
The first waS^ done through a five-item ratinf^ scale which asked-the Coordinator 
in each module to rate each participant in that module on ^evel of particl- 
patipn, helpfulness. and practicality of comments made, level of interest, and 
quality of products. The participants, in turn, ,as a part of the Participant 
Reaction Form they. completed for each module, w^re asked to rate their 
Coordinator on seven items, ^including ability to present information, sum- 
marize points, lead discussions, and^ive corrective feedback, and in terms 
of general knowledge of the module topic, preparation, and organization. 
Tables 7 and' 8 summarize the infonnation collected on these topics from the 
inservice tryo.uts; it seem^ inappropriate to collect such data in the pre- 
service^ tryout. 

There seem to be no dramatic conclusions to be drawn from these tables. 
Coordinators were generally rated quite highly in both settings. Feelings 
about Coordinators generally paralleled those about the modules, suggesting 
a strong link between the two, and the importance of the Coordinator's role. 
Phase 1 rating of Coordinators was higher in G^o^smont than in Mesa Verde; 
Phase 3 was lower. The comments made about Coordinators (included in 
Digests 1-3) seem to provide more insights into this variable than do 
. the ratings. 
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6 

I How would you assesSiJ.flS 3,40 3.29 
this person's Mrtl-l 
cipation? (Four- ' 
point rating scale: 
top-4; b(Hifl[ih^ 

2. How would yqu assess 2.86 2.60 2,64 
the helpfulness of 
this person's 
cownts to the 
group? (Ihree-point 
rating scale: top-3; 
bottOiii-7,) 

3. How would you assess 3.00 | 2,60 2.85 
the practicality of . 
this person's, 
coiniients? (Three- 
point ratin(] scale: 
top-3;bottom-l.l 



2.75 



2.25 



4. How would you assess 2.43 
the interest this ! 
person showed? (Three- ■ 
point rating scale; 
top-3; bottofii-l.) 

5. How v/ould you assess' 3*93 
the quality of this 
person's products in 
this inodule? (Four- 
point rating scale: 
top-4; bottoin^l.) 



AVERAGE 3.22 
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2.20 2.5J 



2,6J 



2,00 



3.23 



2.69 



2.83 



6 

HV 
3.83 



2,86 



2.71 



2.50 



3.00 2.71 



2.79 



2.50 



2.77 



2.62 



3.29 



2.43 



?.57 



HV 



3.71 



2.86 



2.57 



2.57 



4,00 



2.43 



3.17 



2.99 



2.43 



3.29 



7 
6 

3.50 



2.30 



■2.70 
/ 

!'.22 



3.(0 



2.67 



2.67 



2.50 



3.67 



2.86 



HV 



3,17 



2.33 



2.80 



9 
G 

3.73 



2.73 



2.4512,80 

i 



2.25 



3.45 
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2.80 



2.40 



2.91 



HV 
3.17 



2.67 



2.10 



4.00 



2.22 



2.67 



12 



3,40 



AVERAGE 



3.39 



2.80 3.33 2.50 



2.67 



2.55 



3.00 



2.97 



.67 



2.11 12.80 



2.67 I 2.80 



3.40 



2.40 



2.43 



2.44 



2.40 



3,22 



3,40 



2.90 
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2.36 



3.18 
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^ *G = Grossmont; HV = Mesa Verde. 
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1. The Coordinator's abnity .3.00 2.50 
to present inforiMtlofi. 

2. file Coordinator's abiHtyb.OO 2.25 
to suiiarize points in 
the discussion and/or 

* rtadlngs, 

•3. The Coordinator's ability 2,92 2,00 
to lead the discussions, 

4. The Coordinator's ability 3,00 2,25 
to give cijrrective feed- 
bacit on the skill build- 
ing activities. ■ 

JJ 5. The Coordinator's 
general l(nowIedge of 
the topics in this 
module, . 

■ 6. The Coordinator's 
preparation. 

I The Coordinator's 
general organization. 



AVERAGE 



6 

HV 




I = Gros5iiiont; MV = Mesa Verde. 
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The second influencing factor that seems worthy of comment is the 
fdciljties in which the workshops were conducted. At Mesa Verde, these were 
classrooms and a lecture hall in the high school*. At Grossmont, they were 
a large meeting hall in a Methodist Church, located fairly centrally in the 
district. No comments were made by participants at Mesa Verde -regardi ng the 
faci lities-7-apparently this was not an influencing factor. While it did not 
. seem a major factor at Grossmont, a few comments were received of a negative 
nature; Chief among these was the fact that modul^-i had ,to be conducted 
simi^l ||^^Ously -at two ends of the hall, and that 'noise from one was distract- 
ing ^b-^Sirtlci pants in the other, 

' Schedulijig was a far more important factor tn both settings. In 
Mesa Verde the afternoon-evening sessions proved a serious problem. Parti- 
cipants repeatedly complained of fatigue and simple physical exhaustion at 
being asked to work through a module from 3 to 10 pm after putting in a 
ful> day at SQht)ol. While this problem was avoided at Grossmont, where re- 
lease time was made avai 1 abl e. and sessions generally ran from 9 am to 4 pm, 
the time of the semester was often mentioned as* a problem. Counselors were 
still working on changing schedules for students, and also still getting 
things organized for the fall semester (the workshops ran from September 29 
to October 9), and resented taking time away from these tasks'. At both 
settings, the length of time requested of participants was viewed as some- 
thing of a burden by many. They simply were not used to taking more than 
one day at a time aw^y from their usual tasks, ajid felt uncomfortabl e spend- — 
ing the time required. 

Finally, the attitudes participants brought to the workshops, based 
either on local factors or on interaction between local factors and the 
workshops, were an influence. We hoped to have the workshops be a voluntary 
venture for any given participant. Leaders in both districts were anxious 
to have as many of their staff as possible go through the training. In one 
instance some of the participants were actually "drafted," and in the other 
participants felt a degree of pressure from the central administration.of f ice 
to attend, and while they were not required to come to all workshops .vjjj^re 
required to attend at leas^ttan orientation. Related to this, in neither 
setting were participants .given a very good understanding of exac^tly wha^ ^ 
the workshops, were all about prior to their first actual participation;^ nor 
were their needs assessed to determine that this staff development was what 
' • 54 * 



they wanted. Added to this was the fact that participants generally had 
busy, hard-pressed sc^edules to meet, and needed thorough mBtivation to take^ 
time away from their regular tasks. Or, looking at this from a different ; 
viewpoint, they were used to operating in a "crisis" mode which made them 
reluctant to step back from their"* usual duties for any 'reason. (This common • 
crisis orientation to guidance is one of the very themes of the modules.) 
What this resulted in was a lower level of motivatiwi and commitment (in 
some cases) than would have been desirable. ' * 

Finally, the Grossmont. di stri ct had recently .developed a Master Plan 
for improvement of guidance ^^^r^vj^ces in the district, and some of the person- ^ 
nel in the individua^l schools fia*^' negative feelings toward this. They did 
not understand it well and resented what they saw as an encroachment on* 
their autonomy by a central administrative authority. The workshops developed 
skills thought to'be related to the implementation of the Master Plan, and were 
accompanied and organized by this central authority, and there was a tV^ansJer 
of feeling from these sources to the workshops. 

These factofSNall contributed in various ways and to various degrees to 
the attitude participants brought with them to the workshops. There is no 
intent here to blame or excuse--in fact, problems such 5LS poor orientation 
and lack of needs assessment are in part a reflection on the project and the ■ 
amount of preliminary contact, with participants it insisted upon. Rather, 
these factors refl^ect the fact that we were worJ<ing In the real world, 
where >ure" tests are hard to come by. And while these , factors did play 
a role, they do not make it impossible , to c^aw concl us^l^|^out the 
materials field tested or central questions the projeci^'^|tr^ to answer. 

To surmiarize, there were four types of influencing factors that played 
a role in the workshops: 

• •The Coordinators of the modules , 

• The facilitie^^n which the workshops were.he|d 
' The scheduling of the workshops 

• Factor^s in the Settings affecting parti ci^nts' attitudes^ 



CONCLUSIONS AND RECOMMENDATIONS 

Drawing simple conclusions from complex information is a difficult and 
risky process. As one wag put it, "Every generalization is a theft from the 
^truth.'V TJiat is what will, be a.ttempted here, with the knowledge that such 
conclijsigns would require endless qualifications to be truly fair. We are 
aware of this shortcoming, and we ask the reader to be aware of it^also. 

Thref general types of conclusions seem possible: 

' • Art>an'swer to the research hypothesis ^et out originally ?- 

. 1 • t * . .J 

• The audience for which the "prototype" is most suited ^ 

• Improvements .that could be made in the "prototype" and its delivery 

The research hypothesis, stated in the introduction, and boiled down to its 
essentials, is that guidance personnel who have experienced a staff development 
prototype series of activities will demonstrate significantly more program 
development competencies and more positive attitudes toward such program devel-' 
opment than they hgid before this experience/ Th^e are thus two. parts to this 
hypothesis--the competencies and the attitudes; .Let 's look at these separately. 

At lea§t as far as'the subjective reactions recorded in this study are' 
concerned, participants dod improve their program development competencies. 
On their rating of themselves they improved an aveirage of .47 points on a* five- 
point scale at Grossmont, and an average of 1.18 ^points in Dr. Gysbers' class. 
Coordinators rated in5.ervice participants as having achieved the majority of 
module objectives. Most participants felt that at least 50% of the modules 
helped* them to acquire and' practice skills useful to them, that those skills 
would be useful for guidance people in general, and that they were now v^ell 
prepared to use those skills and related specific methods in their own school 
settings. In short, to the degree the measurement is accurate, it can be con- 
cluded that most of the; participants felt they;;^ili|;jV^pved^^^^ 
ci'evelopment competencie^'and coordinatoirs substanj;iatedj^^r|)pini(j^^ 
"significant" these implf'oyements were is a matter of ■de^rhition^of t^^^ term 
"significant." But it is our recommendation that the p^^otype d^velope^d and v 
tried out on this project be continued and built on to improve tbe^ competencies 
of guidance personnel in the future. More objective dafk on immediate and,-^^ ;v I 
/follow-up skill acquisition should be collected in subsequent field tes^ts 6f'\'i'^ 
these modules. . > . \ 

Jh'e data are much less'clear in their sugg^ions,, about positive change 
■ iq^attitiides of par|;ici pants.- Examples 3ili^^(|ly positive in regard tS 



feelings about the development of useable skills. Desire to improve programs 
was increased Somewhat in Grossmont participants, but not dramatically. This 
variable was 'not measured in Dr.iGysbeVsV class because tfie participants 
lacked a personal setting in which they worked. Anticipated effects and - 
general criticisms and suggestions reflect a mixture of positive and negative 
feeling. The follow-up interview at Grossmont showed 56% of the respondents 
felt the workshop could have been more effective, and a mixture of positive 
anjd negative uncinticipatecl. results and general comments and suggestions? The 
majority of comments received in the debriefing sessions were negative, and 
in the inservice settings, some were outright hostile. The: preservice ende 
of-quarter class discussion showed fairly positive feelings, with a sprinkling 
of negative ones.~ To summarize, many positive and negative feelings were 
evoked, and it seems impossible to clearly conclude the "significantly more 
positive attitudes toward program development" were demonstrated. The results 
were very mixed on t\m count. It is our recommendation that in any .future 
applications of this prototype the" factors, contributing % the -nqgati v^e 
reactions be carefully controlled, and increased effort be applied to this 
aspect of the tryouts. 

Some useful clues about the audience' for which the, prototype is best , 
suited seem apparent. Competencies developed by preservice participants 
clearly outstripped those of inservice participants, at least by "their own 
estimate. Preservice participants were less familiar with the information 
in the modules beforehand, ard had had fewer previous learning experiences 
related to the topics; this seemed to make the experience more worthwhile 
for them. They tested higher in the post knowledge exam. They provided 
generally fuller and more, posi ti ve comments on* the Particip'ant Reaction^ 
Formy and seemed much more positive in their debr*iefing at the end o^f the 
experience. Their lack of a program of their own may have represented a 
disadvantage, as it may mean these participants lacked perspective to judge 
their ability to achieve the program development called for in* the modules. • 
Nevertheless, this seems to be outweighed by other factors. The prototype 
seems better suited to a preservice than an inservice audience. We recommend 
that possibilities in this direction be actively pursued. 

. Improvements could be effected in both the materials and delivery of 
the prototype. Chief examples in the former category are: 
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f Orientirjg the content toward a more sophisticated audience for 
inservice applications. 

f Strengthening the practical orientation for inservice appl i.cations 

f Shortening and simplifying textual sections * 

f Simplifying the vocabulary , 

• Upgrading the ''quality of particular phases i , e, , Phases, .,3^nd 4 
f Improving the evaluation instruments ' ^^i^ 

Chief improvements possible in the delivery ©f the prototype are: 

f Improved orientation, combined with an adequate needs' assessment 
f Improved training of the Coordinators 

• Improved facilities and scheduling for the workshops 

• Designating some of the workshop tasks as homework tasks and allow- 
ing more individualization 

f 'Careful selection of settings to avoid before-the-fact negative 
attitudes 

f Administering the prototype to only a genuinely voluntary inservice 
audience 

We recommend that all these improvements in both categories be' effected in 
any future appl i cation 'of the prototype. 



SI 



58 



APPENDIX 



Digest .1 
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V=? ls;* >'^'^'''^^^^ 5-r9»,t>h the. Parii^pant Reaatior\ Form 

■•6. ^ .Did yow feel that ^he modu^^ .helped^ you dcquire- and practice skills so 
^ thqt.i^ou are [nowj well 'prep(R^'q^^^ them in your work? 



. \. *■ \Mesa Verde - Gros$TOht r ^ Dr, Gysbers' Class 

127 Yes 24 No 142 Yes 48 No 

J/ yesj . give at least one example. .. 

Some typical responses: | 
★ 

Module 3 * , • 

A- . ^ 

Grossmont , ^ 



■ \ • ^ 

In some are^s — random s^impling. 

Use of sampl ing -.technique(s) in^assessment of job performance. ^ 

Now I have material I can use to better myself as a person and especially 
help my students.. / 

It helped develop skills in selecting the population and weighting the 
responses by arriving at prearranged decision-rules. ^ 

Defining the population in an educational setting. - 

Sampling techniques. < 

Dr. Gysbers' CI ass '^--A** 

Excellent'on defining goals. ^ ^ 

Sampling methods, aind putting the process together. 
Questionnaires . \ . 
Helpful suggestions^ on how to word questions used in surveys for needs 
'assessments. 

^^ ^ Helped me practice statistical procedures. Glossaries in each module are 
/^?^good; it's good to know just what a writer means. 

How to begin to start an effective guidance program. 
How" to trans^late data. 

The format for assessing desired outcomes is consistent and explicit. 
« However , time-consuming for inservice guidance staff. 

Random sampl ing. ^ ' 

Translating data into desired outcomes. 



Note: Mesa Verde did not participate in Modules 3 and 12. 
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Module 4 



Digest Ij aontinued 
1 Item 5 



Mesa Verde ' * - ' 

Helped place effective goals in proper perspective. 

The use 'ftf sampling techniques in order to gajn an overview of .large ^ 
amounts of input. 

■ : ^ ^ 

Gros smont 

'■'■>:: .V . ■■ - r-: • ■ ^* ^ 

' Construction of ''outcome'' oriented" test items. 

Measuring allocation 6f resources. Analyzing inventory instruments— item 
selection. ' - . 

Any help towards improving the guidance department will help the student- 
I feel examples were too much alike, and opinion played too large a* role. 
Too much gray. 

Counselor log idea*. ! . : 

Dr. GysbersV Class ' ' . - - . 

Helped to get a clearer picture of what is specifically Involved in even 
a casual current status assessment. ' - 

Questionnaires and>^checklists. % ' > - * 

--.-.:i^evel oping new termi(nology and tecHiliqiiies liTK *^^^esslWg the pr^^ status 
of a program^' ^ r; : •; ' -'^^ ■ ■ , ^ 'X - 

-O^trty eouTtsel ing Ldg^*^ ^ ' ^ ^ / ^ 

Logs to determine resources and assessing student need use- of ctleckl ist 
rar|id ic^uiesitlo rlinai res seemed: hHlpfuT : ^ 

Time/task/cost analyses, using ^analyzing coiinseloH Togs-. ' • " ' - ' 

The forms in tfie s^ection can be rriodtf fed a of other 

programs, for student needs or teacher needs for pet^sbhaP eVidluattb^^^^^ 



Module 




Mesa Verd^ ; 

Prioritizing; classifying; P=V'^. 
A method for prioritizing goals. 

9 

Grossmont ' ' 

Revising own questionnaire and sample survey. 

Writing of goal statements--categorizing them--setting priorities. 
Selecting a model in .which to classify goal s. Wording goals and objectives 
to be^ outcome explicit. , 
Writing goals with student outcomes. 
Identifying needs. 

Can now work with/revise the Master Plan. 

I think I finally understand goals and objectives. ^ 
It helped me learn how to ^classify goals and establish priorities of 
counselor duties. " ' f 

Comparing current status with desired goals. 



Digest Ij continued 
■ . Item 5 

Dr. GysLbers' Class 

The techniques used to evaluate planning activities. 
Keeping goals practical and feasible. 
Goal setting priorities. 

Considering information for identifying needs (like desired outcomes 
and current status and their- discrepancies). 
Classifying goa,ls. 

Identifying the kinds of infprmation needed for program goals. 
(Recking what you think are "good" goals against a pre-ordained classi- 
fication system, just, to keep yourself on the track. 

, Drafting Goals activity appears to be designed on a practical plane. 
Desired outcomes assessment and current status assessments. 
/St;ep-by-step explanation of what should be included in a program goal. 



Module 6 



■3^ 



Mesa Verde 



Clarification of thought. - 
Develop curriculum for career classes / ^""^V ' ' 

I Teamed a new hierarcfjy for ranking levels of learning/ 
Did not learn extra or new knowledge. • * , 

Set up objectives for writing skills— using ABCD. 

Grossmont . v 

Wri'ting performance Qfbjectivee for a Career Guidance Program. 

The breakdown of how ; to ^ritfe an objective helped. Understanding what 
performance objectives consisted of helped In the idea of a test. 

I now know the four components of an objective.^ When I am directed by 
edict to write objectives for my work, mine will pass the criteria for good 
objectives. 

Thinking in terms of student behaviors rather than proces^^?'^ 

ril needjpuch more practice— the module WKt will be a great reference 
book. I am alrre to. discern good objectives from poor. ' ' 

The spiBcific components of writing outcomes and objectives have given me 
the knowledge to feel confident that I can correctly write applicable programs 

I am in the process o^ redistributing counseling dijtl)|^. between five 
counselors. We will do this in the organized ways outl inet^'Wlt identifying i 
needs and meeting^objectives*. * ,:rWm 

Dr. Gysbers' Class 



„ Like the emphasis on students— just a general like. / * 
Areas of student development: Educational /vocational , social . 
The discussion of factors ^invol ved in . objective writing. 
There are not enough opportunities to write and evainjate good objectives. 
This takes a lot of practice. 

/ 76 ■ 



A-3 



J 



igcst ly ■continued 
ft em 5 



Distinguishing goals from outcomes^from objectives. 
To. write student outcomes 



Module provides some good points that are h^elpful to follow, especially 
the ABCD. ^ . 

Determining student outcomes, stating ot^jectives for student performance 
i n my program/ - ^ 

Activities quite facilitative in helping acquire skills necessary in 
writing student perf orma^nce objectives {though I must say, these voc. ed. . 
people are difficult to deal with. Good experience, I suppose!). ^ 

•Reworking objectives/ Wouldn't agree with all the "Action Verbs." I 
prefer verbs that are more measurable than "recognize," o-tc.: ' 

The mnemonic device devised by Paulson and Nelson (ABCD) wa^ verv helnful 
in writing a good objective. 

Being better able to sequence the objective. 



Module 7 



Mesa Verde 

Terminology and organization of thought. 

I w'ill be able to select a teaching strategy from a list of strategies 
in an organized manner. 

Acquire - a little mbl"^ than I knew before; practice - yes; was already 
using it in class. • 

Grossmont 

Be cognizant/of alternative strategies. 

This will^ me to take another look at what I am doi-ng and why . 

Elimina;;^ wheel s^nni ng Lets me get to the point faster. I believe • 
^^'^t?!^'^^^ studer)i$ may be more practical if I can help them establish 
fajtgjg^^jL^s^ are available to them and under what circumstances 

^l^jm^^ ^^^^ ^''"^^ decisions. Puts a tool in their hands. 
W^n be\able to develpp program .strategies for our school. 
Trte strategies we wrote for one objective using the four levels will 
< for other objectives. 
I will look closer at criteria for my decisions. 

Dr.^ysbers' Class 

Using the group process in reference to staff members to help select 
program strategies was very informative. 

^ ^t£i]._th^:LX_3rLJ^^ - " - - - ' 

'^r This module gives me practice in rationally selecting alternatives. This 
can be more systematic and thus more efficient. 

Good reference material. 

Implementing objectives. 

Looking at the alternative program strategies, I believe, qives one 
total picture. , 

The criteria for the choice of a strategy is well defined and very easy 
to apply. J J 

A~4 ' ■ 



77 



Digest ly continued 
. ■ I • Item 5 ' 

S%riting criteria for considering aTtfirnate strategies for guidance 
objectives. • 

Being able to generate many strategies as opposed to only a couple. 

It helped me. develop a Vist of possible strategies that I can use as 
a check list when I am teaching. 

Recognition of the use of a decision rule is great help if you are 
interested in making consistent decisions. 




Module 8 



Mesa Verde - ^% #- 

Probably more confident in what I'm doing. 
^ Time/ task/ talent chart. 

Stated what I already knew in different words. 

Grossmont ' ^ 

Pert charting. *- 

See application activity objectives, worksheet, and "pert" chart on * 
field trip. 

No it didn't help a lot. Yes I feel well prepared. 
Assist in organizing college advisement program and graduati^on. • 
I need more practice in order to be effective. * # . 

Time/task/talent charts. . 
Defining scope of probl ein;^ i temizi ng steps in process\to accomplish a task 

• « 
Dr. Gysbers' Class ^ 

Th|[acti vi ties in general helped to pull it together. 

It helped me to become familiar with details I have not yet experienced 
in a sthool setting. 

I like the structure andgexamples of the Process Objective Worksheets. 

How. to implement strateg^s--time/task/tal ent chart. 

It helped me practice skills I had acquired previously (PERT). The 
activities are excellent. 

Task del i nea tion. ' - . 

The specificity concerning task developments was helpful. 

The Process Objectives Worksheet was a big help because you were helped 
with the organization of the essential parts of the- objecti ves in a sort of 
f i 1 1-in-the-blank procedure. 

Gave very specific and good examples of "Tasks, Conditions &^ Criteria." 
Wri tijTg_BnDtess„obLi ^ „ 



Module 9 



Mesa Verde 



I feel the actual application is somethijig .1 want to do. 

"Doing" gives me a practice thus more feeling for what I'm doing. 

Clarified staff use. „ ^ 

78- ■ 



Digest ly continued 
Item '6 

Grossmont ... ;^ . . 

I|m better able to synthesize mythinkina as to staff responsibilities. 
I'm not weiy prepared, but now I could Write staff development objectives. 
In providing a written model on which to project the. activity and skills. 
Relate staff skill to behaviors. 

Dr. Gy . bers' Class . ^ 

Acquiring a better understanding of all the tasks related to carrying out. 
a particular strategy. 

This module seems to be more relevant to the work of the Guidance 
Director than to the individual staff members. 

Finding staff development objectives. 

Ifeel the module dealt well with the handling of staff in the .transacting 
of information, developing objectives, information sources and resources of 
staff development. Strategies he^lped a lot. 

Develoj3ing staff performance objectives. 

The emphasis again on the four factors (target audience, behaviors, 
'conditions, criteria) is made very clear and becomes quite useful. 
Giving l^sts of places to obtain information from. 



Module 10 



Mesa Verde . • 

Al ready fami 1 iar with concepts. 

Defining ongoing evaluation methods. . - . 

Development of better assessment techniques. * 
•Strategies to apply to pilot testing. 

Grossmont : • ' 

This will al 1 depend on who (administration) will be doing these activities. 
New light on importance of how you select your sample for a pilot ^test. 
When and when not to pilot test. 

Dr. Gysbers'^Class • 

Dividing up objective so you make sure you get all paihts. 
The glossary has provided new phrases , ^definitions. 
Good reasons for- why to have test pilot. 
When to pilot test. 

— >.-NQnB_wer^.caas.i..der-a-bly -usef-al ^-4.n 

previous skil Is. . ' ' 

I think module gave me some background on pilot testing the progr;am and 
monitoring the data so that revisions can be made early in. the program format. ■ 
Good idea to include information of the co^ts of an activity. 

I don't feel this module gave me the competencies which the previous 
rpdules did. 

The "internal logio^" questions 5re"^valuable in assessing any activity. 
Estimating costs. 



Digest, Ij continued 
•r^ Item 5 

Module 11 ' ^ 



Mesa Verd'e 

Cost effectiveness ratio. 

I wi 1 1 now better be able to evaluate some of my course objectives. 

Qjrossmont .^^ 

Presentation of data to public. • - ' 
In a department survey to be given next spring. 
Computation of cost effectiveness. 
Selecting a testing instrument. 

»■ 

Dr. Gysbers* Class 

J 

. * v> 

Selecting and developing instruments. 

Very useful in pointing' ouf the different sources to retrieve informa- • 
> tion on instruments. . 

The cast-effectiveness ratio is a very important concept. 
Evaluation design^ 

The practicalities of choosing a random sample. 
Module 12 . ' 

Grossmont 

• • 1* * ^ -. ' 

^ I learned the difference between summative and formative evaluations. 

DAT testing program report now in the program. 

I believe I could conduct a summative evaluation. 

Report wri ti ng. *^ 

With Master Plan. 

The most useful module because it taught us to report our decisions. . 

Dr. Gysjjers' Class - ' ' * 

The logicial way this chapter was laid out irhpres^ed me with its usability. 
It went through the important aspects and put them in a form that can be 
used for later reference. ^ 

I was already prepared in this area. 
Giving a presentation before a group. 
_ ^ Developing communication str^ategi^es (co^^^ 

was"!outTined'"w^^ VxfTlained^exterrsi vely. 

, I believe. that I can present a more appropriate presentation because of 
• the "Varying Communications Strategies" .section. 

No one ever mentions communications. Glad some one did^ 




, Digest ly continued 
Item 6 

-y • H 

i 

6, Could you use specific metfLods from this module to improve guidance y 

counseling y placement^ and/or follow- through programs in your school setting? 

Mesa Verde - Grossmont Dr. Gysbers' Class 

t 

139 Yes 10 No 168 Yes - 22 No 

^fy^Sj . give at least ^one exampl 



Module 3 ^ 



Grossmont ♦ ' - " 

Working towards desired program outcomes. 
Questionnaire development for needs assessment. - 
Find out wh.at students wants or needs are. 
•Al umni- survey. 

By developing a supportive and involved advisory board to help in 
desired outcomes assessment. Also use sampling techniques to get at outcomes.' 

I have method >written down and I can refer to^ these -to improve ttie 
guidance program at my schoaK \ ' ■ 

We plan to administer a questionnaire to aTl freshmen In October to gain 
some insights before we meet them in one-to-one meetings. 

To implement the "Master Plan." ' 

W6uld need to be implemented by administrative personnel." 

' Dr.. Gysbers' Class ' ^ 

Defining goals. ' . . . 

' Most of the methods for condijcting and assessing desired outcomes are * 
quite feasiWe jn my opjnion. ^ - ^ ^ 

The whole step-by-step' procedure was very helpful. * * 

Conducting 'a sampling survey. 

Cfef inihg the population. f ' . - : • ' \ 

The card sort seems to be very useful in determining , needs" -of students^ - 

The lists af needs helped to' focus on actual desired beh^iviors. 

The sampliagrm^thods. • - *' ||t x 

. Gat±erj.nsu^and:-a^arli^ias.o:t.da±a^v^^^^^^^^ ^ 

The card sort would be a very uS^ul method especially, on the • 
col lege, or university level. ' . . ir 

^Setting up an advisory committee; selecting and sampli^a sapiple; 
selecting .and developi^ng an instrument. ^ / * 

Lottery /nethod: . > 

^ Setting up an ongoing .advisory council".". 

*• Evaluating >your prograiti, setting priori' ties, eliminating poor metho.ds and 
techniques and improving your program overall. . ■ ^ 



Digest 1^ <^ontinued 
' Item 6 



Module 4 



Mesa Verde 



A method to assess needs and develop a program to reach desired goals. 

The method for assessing available resources. 

Types of test^ to give--relating thefn to what you want to learn. 

Grossmont , - 

Adapt counselor log to data processing form to use a tool or- i nstrument 
in time, task, and follow-up. ' 
Counselor log. 

Measuring current status of students. , \, \ 

Awareness of desired outcomes and its rel atioHsTitp to .present (student) 

status. \ I. 4. 4. . 

It gives me idea^ of how to determine where we are and where we want to 

go and be. . * ' ^ . ^ 

. Dr. Gysbers' Class 

Career Maturity Inventory. I would like to know more-about tKis instrument, 
Time/task/cost- analysis. ||| 

The keeping of a daily log.- ^ ' 

Developing assessment, instruments. 

Daily counseling log and Missouri student' needs assessment. 
Getting information. ' ^ . , ./'^ 

Logs, questionnaires, checklists. 
Student. assessment instruments. ■ 

How to summarize and analyze current resources. How ta devise outcome- 
oriented and objective statements for assessing current assessment. 

By using the counselor table one. has some analyses to show administrators, 
aid others, how they spend, their time. ■ 

W It showed me the necessityof carefully designing questionnaires using an 
outcome oriented approach rather than a proces-s oriented approach. 



Modul e 5 



Mesa Verde 

Getting my priorities in order. 
A method for classifying goals. 

Grossmont 

• ' f, ■ " _ _ ■ 

Determiniag what percent of time will be spent in what activities., 
In setting goals and priorities. , _ ' 

Setting up goals and objectives that qould better substantiate our reason 

for being." . 82 



Digest' 1 J continued 
• ' V ■ ' ^ '* ^Item 6 

^Especially J n setting up new programs. . * ' 
Hopefully, ^in implementing Master Plan. ''^ 

Really opehed up thinking more than anythilng. ' - '-^ 
To set priorities via the Master Plan. -i 

A tool, to rank and prioritize counselor duties; i.e.", curpertt status vs- 

desired outcomes. ' ' ) 

Dr. Gysbers' Claims ' .^i?: • ' ■ " • . 

ABCD is really good. 

Classifying goals. . m 

. Working with priorities according to asses5rTient§^;|S^,'- ^ 
'/I believe that the part cffi setting priorit-ies, is&'mportarit 'on any job ' 
>;( program. \ v^. '^M^ 

^" 1^; . Classifying goals accordjnq to some sch erne ^^J^J^V ' ' 
.'^'^^^ Classification System (AIR); checklist -for well written goals. * 

-Ihe section dealing with goal development, more ipeci f ical ly , i n regard 
to job possibi Vi tVes, and placement. - ^ 

Thfs.'TTiodule gave clear, step-by-step (more or less'I) i nformation, on 
establishing program goals. I felt that the examples were very cleaV^^and 
instructive."^ " y • ' 

Module 6 . . — - . CI * * ' 



Mesa ,Verde * • ^ " . . . * . w 

In,^: writing coarse uni'ts for teaching. * „ \ ' ' ii 

Training aides. employed persons not f ami liar .with it. , .' 
Writing awareness, accommodation, and .action objectives^f or var^ious ^it 
courses. ■ '..v ■ , ' 

: ^ Organizing work schedules and task assignments''^ - . 



Grossmont 



. In development of neW goals and« objectives'. ' ' . . 

Using Action verbs to identify outcomes rather than- vague generalities. 
How to help other' counselors and teachers to use goals and objectives- 
and the need for performance objet:tives (testing of results). 

N![pBii:le- has assisted in bringing to focus the need to plan apd establish 
rObje^^irf^es whi ch can be measured. , ' ' 

^ J have' a better understanding of our '^di stri ct ^Master Plan in guidance. 
To get freshmeil to know dll of their production requirements by the -^S 



time>they have been 'in class, in thel?^ f>r$t semester . 

^ Cbl lege- bound students how receive an Inordinate amount of attention from 
ORe counselor. He is going to be I'orced' to identify* his. students' needs, the 
outcomes, and objectives. By identifying', the. audience, behavi'or, conditiqpsv 
and-degree, he will alter his approach to service aJX of his students in an' 
organized and effective way. ^/ / • • ^ ^ 



•v^'' J I- Atftually specifying stud^pftrmance objectives. 
!>*.< Nothing is specific enouSHkyfle to uie ■ 

fe,.' 'X.AlStoSSrif student objectives through the educational , vocational, and 



.tegorization exercise as to whether the outcomes,are "awareness,^ 
c^KKm^l or action-oriented"- may be useful in determining if future 
prOi^lMnm^^ spending their energies equally between the two 
. 3sing the available banks of objectives. 
.Stating Outcomes-.- ' \ 

■ ' * * ' . - 

7 , - • .* 



■Mesaf^Verde 



t^ooJp^^^m2.^J'■^^^'^ strategiegtfrom which teachers -could 

. pOGse to meet, their teaching ^jectives. v '■f 

• Planning and implementation of strateqies. 



Plan guidance VQ|||ram identifyi:ng most appropriate us^ of strategies. 
^ . i could use m^e^Wtfs in inservice or in daily counseling. 



. Gross men t 

e^/'.- — — - 



.nH ^ t° t^'^i "? ^bout Sharing of idgas to form "menus" of poss'Ibil ities 

and .need for compromise. ■ . • h^^^ 

lean force others to actively question wtiat they are doinq " ' 

Determining strategies, for the. Master Plan.- ' 
Group session with counseling staff to dttermine strategies 
h.wo • c'^eatiri| a great deal more. organization. Much of this- I ' 

have been using, from my twining in social wo»*k. . I have not been able to ■ ^ 
. label or organizer it, hdwever. ^ ' ^ doie to 

Try to get counselors to think of other .strategies that might be used to' 
mprove our .department . Li ke . _hoy(. .can- counselors, hava. more t Se to tb nk 
c about how we can be better couris-elors. * ' ' M' 

Better use of my Jime. . " ■ W \ ■ . 

■ - Ou? department needs to .bra'iostorm. ||^e must be' a - better way.' 

• Dr. Gysb&rs". Class :j . | 

Becoming more acut^y, aware of the strategies .which at» presently being ' 
, used in career guidaRce^eprograms . ^ * "t^ntiy oeing. 

the "menu" of strategies' is a valuable reference.' 

Surveying strategies. ' : , . 

The breakdown in. the four^ steps for'^eci si on making. . > , " 



; ■ Digest Ij ' continued 

Sl^-::^ ' Item 6 



/ The whole idea is helpful >bii(t' i t could all (the total course) be pre- 
sented in one module. ^ ■ / 41 

Gave steps .to use to Took;#t the program strategies and help decide which 
strategy would be the b^st , in terms of time> cost, and creati veness. 
Method of choice ^od;^-hatp5 to narrow down the selection process. 
The ideas of ways .to f.e^ch students for getting them career oriented. 
I will probably use thi;^?; information in implementing a guidance program 
in my future occupational, slitting. Being able to select a specific strategy 
will prevent any aimless^jylnderi ng from activity to activity trying to fintf 
one that works. . V/^ j^' 



'Module 8 



Mesa Verde - * %|| '\ 

Not specifically oriented vto guidance— ski Its afiply "to any program. • 
Assigning responsibility^-i?ft',s 'generally done on a much more simple level. 
'I can get staff members to adopt the process involved I think tbey I 
will b'b<;ome more eff-icient in their work. 

iBrossmont 

i» 

^ These fnethods are practical needs to be met in any guidance projectr- 
. and are built in for the project to flv. ^ 

. Assist in anganizfUg college advi^ent program a^rid graduation. 
In identifying tasks relating to a strategy. * -Jf v 
A^^guf^l "j^nes for implementing any specific strail^gy. 

kt) ers ' Cl ass ■ ' ^ ^ 

^ . t . - . 

'^nly general organizing abilities. 
The section on scheduling -process objectives was helpful. 
PERT and Time/ task /talent chart are very benei^f icial . ' 
Assigning appropriate staff to objective which they are most^ skillecfc'^M^^ 
interested in doing^l ^ • 

Suggested methods of deteteining the skill level^i^pr Writing prqci^s^t^ • 
^. objectives, of staff ijiembers cluld be used to improvFall educational pf&- / iti 
* grams, not just guidance. lib . ^. . 

Module 9 ^ - - ^ * ' 




Mesa Verde 

Gives a total picttPe — leads to deve.lopmpnt programs in an organized 
manner. ^ * . . " 

Many items '.were alr&ady being used. , . 

The method could be used to improve. any prpgram. I don't updagiftand the 
focus 6n,^uidance. } realiaje it will help it a^^is method woul^el.p any 
program. ! * . / - * * 

. A-12 ' * : 



Digest Jj continued. ' 
■ z ^ Item 6 ' " 



Grossnont 

Interesting guidelines on methods of "del i very", for strategies, 
^e will ifflplement Grossmont Master Plan. 

Developing some inservice training programs. ^ 
Use of stj|||f to broaden counseling outreach.*^ 

Dr. Gysbers' Class " '' ■> # 



.0: 



I like the structure of the worksheets, especially the one dealing with^ 
•Delivery Methods." , /' 

Staff implementation and appropriate use. 
The format for ijfciting objectives is very useful. 
Delivery method^Ror staff development. 
Staff developmenrlbheckl ist. 



Module 10 



4 . • 



Mesa Verde » 

• — > 

Measurement techniques. 
Methods of monitoring. ' 
I could not: ^ 

Grossmont ^ 

■ Pi 1 develop cost analysis.'^ 



Improve career center.. 



Monitor ongoing programs.^ Pilot test neW,; progjraj^ v- 
Planning the^ general ^ strategy for pi'W|j^t^&sting/^^^^^ 



program for a Work ExperVejnce Program 

i t ' t 

Dr. Gysbers' Class '!^' 

Preparing for a pilot tfest wis q^Jljb 

CP)ecklist. ^ ^ ^ 

Jfcevelop^ j^ reiatively accurate estimate of the cbst*ofj 
guTphce activity A - f 
. process objectives methods. 



informati 





Mojjule 11. 



Mesa Verdg > 



The concept of .quasi experimental.^'. 
Cost analysis; decision ' ^ " 

■ #; 




. . ■ ■ ■ ' ■, ' V .V DH>l^e^ continued 

'W*- > • 'V.;^^:' f ' ' ^ ■ ■ . • V'--\v' /" Item 5 

Grossriloht .....^ * / . ; , \ ^ 

' Specif ic'Jtypfes of 1 nstruments-^t^t^^^^^ . x 

To work^ith other PPS personnel an ^^^^^^^ ' > ^• 

Evaluation of the department »survey^ ^ , / 

Cost/€ffectT veness figuri-ng. . a"^^' ■ <> ' 

Motivates" investigation of current iDro^ram rat:iojia1'e wi th regard to*" 
effectiveness. " ^ -"^[/..r--/ 

Discarding ineffective techniques, after measur^ent. 
Evaluate our role as attendance clerks. ■ • ' m: 

Dr. Gysbers' Class ' . ' . ' 

Relating program/costs to prMram effects, -^jfl- 

Tha, section devoted to significances was very informative in explaining the 
need ta examine the educational along with the statistical significance. . 
Selecting summary andianalysi s method.. , 

The concept of accountabilityi;^ Brinps out'^such points as the success of 
the program, changes that are necessary /and whether it should be continued. 
Evaluation. . . • 

Measuring behavioral changes^ i* students. 



Module 12. ^ ^ ■ . - ? . • 



- Grossmojit ' '^j^j^.- ^ i v.^. . 

Evaluate the work, of counselors at the^^i|||Bnidan'ce window each'a>i^^^ 
Evaluate total, prpgram to formulate rationale folr i ts exisjjt'ence. \ 
Report results to decision makers before "the wol^i5 a't th4^^o|?|*' : 
Programs must be evaluated in order to be justifiJI, ' ^. . -^j^,, - 
. Development of Master Plan. . # ^ '"^ / 

Reports to principal regarding recommending changes in guidance progrant' 

\- Dr.- Qysbers' ClaSs # ' ; ' ' : ;^ 

'k!Jc^ on communicating is -teluable when you are'in a school setting dealing 

and parents- Section of audience, characteri sties is. an dfti^ 
f/i^^^fgo^^^ 4)art of reports. Gla'd 'ft was included, || 

"^^^C:^^ specific l^np,w ledge of how to wri^ a summat|ve evaluation. 
J*^;. ' • ';Tti^Jwiole pro^r^ini^ . . . • # 

V V" ly^el I can (|feTiyer clearer and more cogfrse reports, 
i y^jjk^ °f sophi'i'ti^ation of ^e audienc 
• AuHro visual meahs' of repornng 



Presenting evaluation to ""communi ty-; or staf f , 



. . • ■ Digest 1^ contiinue9l^ 

'/ ' ' • . 'Item ? 



7.* Are there ways in which tne module inaneased your desire to improve guidance^ 
.. couriQelingy pldoement, caid follow- throiigh programsHn your school setting? 

Mesa Verde - GrQssmont ■ 
115 ^Yes 3| No ■ 

If so^ cite''i(fl^ examples; if not y eX-plain why not,^ 
Modiile 3; f 

y Grossmont 

To imDl£ment "Master Plan." 
:/ )^alidlPlentification of needs at my;school— my special e.d. population 
■' ;Tf specifically.^ It gives m^-^push to implement a scheme toilfee what students 
, ■ see as ways could be useful to them. 

It emphas'izes the necessity of being accountable; it provides tools to 
''^ identify areas of needs; it provjdes the tools that can be used to measure 
accomitabi lity. 

New incentive to develop and implement my school '.s plan. 
.'Did not increase my desire as it. was always there but did show how it 
migh.t. b6 done. 

- ^No... It sttn sieems overwhelming! 

No. Improving guidanqe in my sthool \Wauld ta'ke more* energy t\ 

/ . Mesaj^erde \ . U .^ - \ , ,. ■ ■ : 




Needs .as^ssfcent,; the importancfe^ goals. 'ft'- 
jj^.,^ Measunerr^^ for developing assessment instruments. 

% Myjy ^J^PSfes clarified; rbrward-looking. testing program inyol ving whole .J^^^Tt 

,..cha(^is'_nee<fed. ' ^-^^^^ ^ • * . ' ' 

ArAt ysJ^ by log (time, :^outcome, etc.) of where my time is going— Is it^. * . 
^ whaft I wmfKr Is it the ;b&t investment of money? ^ • 

• .More conscious of stuaent^need" concerning \fl(hat I am now doing and what I.^ 

^ could or. should be doing. ♦ * N ; 

Counselor logs; examfning what we reallyfdo ^ach day and how worthwhrle 
. it rtaliiy M. i » / " * ^ • 

' ^ 'mL. ' ^^^^ • ■ . • • 



tote 
on 



e: "^tlhli item was not applicable- to oreservice participants, it did not appetr. 
Ift^fcll^Pp'lonnai re jiven to iJr. Gysbers' class. * .^j. 
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Digest 1, continued 
■ Ite§ 7 



Module 5 



MefSa Verde 



Gave me hope through skills; I saw a basic need for our school to set 
priorities. ' * 

The method for assessing current status; the method for setting priori tiesT 

Gro'ssmont , ▼ • 

Rewriting my school*s plan. We were really fumbling around last year-- 
did not have any training at kll. We still have a long, way to go. 

Better understand total scope of Master Plan and ijMlementatfon. Feel more 
competent in Vjpting and/or evaluating goal statements^ ' 
To avoid mil i cation and wasted ef^rts. 

,1 see theBpportance of good classwication--i t dqes not appeaii* easy to do. 
I am excired about getting the couns'eling program to become more systematic*, 
f alsjn think it will get Counselors into the classroom. 

Module 6 ma 




Mesa Verde 



In 



Self-awareness programs, inc]jgling j^isOre as p^irt of the career education?^ 

ocus*. ' - ' : ■ '° W ' ^ ■ i 

' No. I wanted to aipply techniques more, by pV^odudng objectives tS replac 
sMe that we havfc^sthat Mve proven inade«j%ie. 

^^' jt^r^ more ccftifident t6 ilse ™terials; JwHnservice or answer questions 
for rfly^^Gluster staff. V 

Grossmont ^ 



ERLC 



Provides an opportunity to change my job-desar|ption fX0t(\ clefi carworL to 
working with groups of kids. ^ / 

Provides^ a means to make classes* more relevant to'kids. - , 

I see how ta involve the whole staff /and motivate p0ple that have not 
worked-on Carew Guidance in the past. 1 can see that students need more 
career guidance. ^BUT, as department ctiilrman for 12 years w|^h a ||ad|pf 439 
coun«lees>^:.t|l^^ little time as it'i;PI|!W to* add anything." 

i^ Points, up need for agreement arron^thet^guidance staff as to what fs 
; . really jmpgrtant. StJiesses need for' J;' program description which i^^avai^J^able 
"lia^school ^i^onnel and the p^bllc,^^ ff ^ ^ ' ^^"^^ 

^1^- increafing awareness df writfl|||| objectives i^:^ comfortaMe With 

• the -process and feef more willing to undertalce the task'. Outcomes vJn^ch can 
Jr^e measured will reinforci whefe prb^rafns are strong and maybe change 'will . 
occir in weglkSmis. |P ^ 

0\ng Is so foreigrTM;6 m6) that I Just;,didn' t get turned on. 
le can be positive liifl^ • 
) I may be tejnpted to w(^k less at affective counseling; it is 
document." Ss- . ' " '- ^^^ijl^ ' : 

m, 



What wel 
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/ ^ Digest Ij" continued 

Item 7 

It will he.lp me set priorities and measure results. I believe it will 
help me put into words that which I do; this is very hard to explain sometirrtes 

. I now have a concrete procedure to follow to bring, about the necessary 
changes to make myself and counselors be more specific and accountable. My 
.approach to problem solving has been affected; I am a little more confident 
about the writing aspects of problem solving now. 



Module 7 



Mesa Verde A 



. In' classroom work; in helping with the inservice. ; 
To heVpi^students to identify alternate strategies; to have, the skill to^ 
.use strategies which can improve guidance. 

Programs can always Jteft. improved . » . , 

Grossmont .^i ' 

P/gpciHng "packets" "or programs whicfy||ill permit students to be^lware 



of an^rna decisicJTi m|pp(i^. M 

D?t^ding whether a behavioral jjerfonnance can best be achiiled via an 
individual or group process^ . flk 



rit '^gULg roups of counselors 'together to talk and share ideas. I gained 
a sense^lHfenthusiasm from;^ facilitator. 



w Clearer understanding <th# task ahead-. . . . 

-jl. Better control what 1 M- ■ 'M * V ^^^^ 

How can vye./jee more students eff|ctivelyi How qJ|f;jc:ounselors find time 



Better control what I M- 
How can vye./jee more studei 

.to grow on the job. . 'y^' , J ^ ^^t^ 

^ Help stud^ts expl^ore morJ^^'ait^j^ J^ffee^^ in thinking of 

Qall pp«ible/aUernatT^e%^ /' '."^ ' ' * 

AgiooK for preferred a wjear^ati ves#^^ changes by. sound criteria 
insffead of "It woul^be a rtea*t thing do." 

)!^^i^'^fio^- . My desire tQ- improve gui'd|)Sfce has always been pretty high. . ^ 
'i^fe^s^^ being done, ana not because of the module. • 

'^ - To perform .ite^^^^yyii^ develop'lny own goals and arrange their^^ 





y nKjdjjjjf , in i ts^l^, ^doe^ n4t^^^_^^ . 

:ing Ipfecific pl}j^ iifl^liEareer Centers. Assign^ing responiji- 

n*1itiWfo'r achi^v>|j^, j:lte a 'H^ \ . 

Be more svst^nMj^tic ^and 'd^ ^ jf ' - ^ 

Better ca%ep cOLHRS^ellng/ Good way to br^^up big things into pialatSble 



bites. 

M. *' - . ... . • - A-17 • • V '^^ 



Digest 1, continued 
Item 7 



Module 9 * 



Mesa Verde 



ERIC 



To develop an open labora'tory for--r»ad4jig imoroveiftent. 
No. The^module was repetitious and a waste Sf time, time that could 
have^been spent in developing specific programs for my present class. 
It made me aware of'the needs of staff; some one has to do it! 



Grossmont ' 

Developing strategies ^ our career center. - ^ 
How to find the people with needed skills. 
Desire is hard to quantify. ' # ' 

Pointed out the need to. be organized.. Pointed out the need to be very 
clear on goals and' ohjictives . • • . 

Module 10 ' * ■ ^ 

Mesa Vei»de . ' 

\ ■ " • •' . ' •' 'M , ■,.„, ^^ ' , . . ' . 

It gave me an awarenajjfi of some of Me undon§ paV^s arf our placement ' ' • 

Pi'ogram-.- ^ ' v . 

•No, because I already had the^sire. ' ° 

, -..-i It gave mi|^pac.i-aj|giifethods lo fi#d info techniques. 
, To be ablff^o betHf assess s;tud#t needs; to be able to assess whether 
these needs are being met. a 

Taught me||j|t we need objectives and student outcomes; more adequate 
monitoring ofiw^oing and new progi«ms. . i" 
^ No; most^ t'he examples used itki^he mo4ulQ ,we*are now using. 

-. Grossmont ■ ■ ■ . ^ .'f:^^^ ■ . ^ ijl'-f'^'' 



If ■ - 1 «. 



'Need, more evaluation. Need to formulate better pbjedtfves. ' "= 

Would like. to develop a postgraduate employment survey for needs assessment. 
Need to take a gdod hard. look at progyam logic. ' • > 
C;ost analysis/effe^iveness. (Good stuff.) ' ' -""-^ - .■ - 
Added to the frustration of Being located in a status quo guid^nclf ' fit- 
department. ^ • ' ■ 



pdule 11 

>1esa Veril i • 



No. I already the desire. 

My desire t.a imprSVe the. girograms was very hi^h to bigin with. It gave 
methods such ai cost analysls^d analyzing the validity of a program. 



A-18 * • / 



§Pigeai\ i, ^ apntinu^d 

^ \' Item 7 



Grossmo nt ^. 

Guidwce work in the area of careers. 
Cost analjifsis. Evaluation methods. 
Presenti ng data. 

Need a more student-centered program. Need more on-going evalua^on. 
Evaluation can be used to ?how staff what is done. 
A logical pre- and post-testing, eval uationv^dnd reporting these 
results. Y 

We need to evaluate the effecttvenesSr of the OVIS.^ We need to evaVuate 
the .effectiveness of our college counseling program. , , . 



Module 12 ■ i . 



Grossmo 




Woujd like to establish peer-couri3|$1:r^^^ a mare active 

role in working wi th .teachers in and out cff the classrOomwy 

Fcep'ort results of rPrttl-e- known programs. Provide visflll ity and recogpi tion 
to practitioners through reporting. ^ ^' * 

pl'm anxious tarf^ey^l uate the advisorship program. I would like to 
evaluate the .effe^ti vehesjg *of scholarihjB counseljj^ 

Module req'uirfes mo»4 astgdj^--! do beWer wi tfif^ step-by-step "mechanical" 
nuts and bolts presentatio#r^ ,,:!;!^^.<v^ • - # 

Did* not increase my desire to improve guidance; did improve my capability 
to do so, I brieve. 

How^ tj^effecti^^tely collect data , what type" Of data, and 'then to write or j 
organize a report. ' \ . , 



Digest 1, continued 
Item 8 

^Hfr ^ ^ ' _ 

8. Did you experience unanticipated effecte (positive or negative) df the': 
learning in this moduVe? * . ■ . 

Mesa Verde - Grossmont ' Dr. Gysbers' Class 

65 Yes 80 No ^43 Yes 6^ No 

If 80y describe them: ^ ' ' s.. o 

. ■ * .«■":.* ■■■ 

Module 3 ' * >v ' * 



Grossmont 



0y 



I didn*t develop the complete understanding of ^^^iviiHpt desired 

r outcomes that I thought I would. It contained areas tha^were a surprise to 
me--sampling, weighting of sampling, etc. . 
I f el t' rushed' some of the time: Also some assumptionf^about how far alone 
Wshould be were not on target. M 
- . . J^ot as exciting-stimulating as expectecFor hopedf pleased' With simplicity 

snrf comprehensiveness of module. ^ * 

Dr. Sysbers' Class . ' : ^ V ^ 

It seemed as" if population sample was a "rehash'* of R37p. Had enough I 
I believe that Twill be better able to judge ..the validity of other^ 

st;udie5. - ^ ^ * ^ ' i ^ , - 

I think, the series as a whole inadvertantly points diit the enormous 

complexity, of starting a program ^f t||iis nature, and the nefessity of^develop- 
Sfng prqc'ess. ... m 

ModulA 4 . 



sa Verde 



Positive; it helped me to develop a 'critical attitude. 

The cl^ir and .concis'e, manner of presenting. a cq||ipl ex .process. 

I didn't think it would interest me as much as it did. 



Grossmont 



and career guidance. I have a feeling of -being -too slow, or having 'diTficu-lty. 
grasfllnfl some of material. • . 

iJltliill force me\ to encourage the ref-exami nation of our roles on the^'job. 
'•yA jjip: of materia^ to absorh|in|A^ short timev . * . ^ ^ ' 

positive efrect^of lealer^ ' ^ ^ 

A-20 
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Digest Ij continued. 

-Item 8 



Dr> Gysbers* Class 



. I did nfet think that I would tnjoy. i t. » , . - ^ - ^ 

:I am )»rni.n5' ho^ to »fOcus' on Slpfecffics in my thinking. I havera^'' 
- v.^tentf&hcV't^ In vjery global, vague terms. .Glowing reports don't 

'-^^^^^ ' ^ ' ♦ 

Li " can be applied to church settinpF^^t^- 



' I found' that th6 process for assessing current status of. a program -is 
a lot more involved than I anticipated. 

. ^ ■ V*'' ■ ' ; . . .\ 

Module 5 ' 1 # ' • -i^ 

• ' ' ' • ' t 

Mesa;4/erde 

Again, it became interesting aS: we got into iti . • 

Grossmont • - . " ' ^ * • 

I have new energy to try to triripaboyt thange.' " . • ' 

I received help in present on-going project. ^ " ^ . 

? ^ I feel more competent in writing and/or evaluating goaT statements 
V The bitphing. sessions may in the end have fiad a ^therapeutic effect. 

Dr. Gysber^' Class ^ \-. 

GaUl setting wtthiin.jny own personal 1 ife. v 

' POSitfviST I had SVeflDO^^^^^ of e:Stabl|||B''^ P^i^^i^'^^s. based ' 

on. limited resoutces ^nd possible rarck of freedom for c| 




Module & * • . " [ / 

^-^ «esa Verde ' * * ' , # 



-I- . 



^^^4if'ter a' hard d^y's work one lacks" tft?^-*W5^f^tio an or ttf /dbV^ ^ 

"iBnels l)esTl By the oattassessment l didn/T:WrHe positive learning; ^L., 
was only writing to^^^plete so I could go, home. * \ ' 

I was SiUrprised at how.-much 'of ,this; 1 aliceady^, kne and practiced— but 
it||Bncou raged me to use 'it more intell igentTy fhan.' be^^ore.- ' f 

\ ■ ^ ■ .. • "^K^ ' • ' • • . ■ ' \ ' 

Grossmont • .... 



The dlsjbussionsperiods were too long. You r^^ad^rto ei 




There was frustration with the cgfciguity of^srequfe^ ^ 

. I. had to go bveW \t a number of^pimes and. kept forgetflnf 'jparW;' 
couldn* t.seem t6 .tie* i\t all together^* Th^-.ABCD gimmick copnected with objective?. 
M^lfte big help.. >1 . • - ' . - : ^ k 

Tt helped me to, organize # thinking . .^Sharing vieWs and^fbrmatioji wjth^ |^ ' 



ERLC 



* other partjcipaots was particularly helpful .^Jiij^cecl me tG^pccomplish 

y^:^ •:soinetipg:- ' a-21 v'? ' ' ^ 



J\ rregative, doubting attitude which I had was displaced by an appreciation 
for wnat 'the module did offer. Much'of/the credit for this change of attitude 
is due to the . coordin^ator of the module. . 

I became a little. more irite,rested in getting a program put together soon* ^ 



•Dr.-Qysbers' Class 

I. was surprised towind that catalo'gs of objettives are available. 
^- I 'became aware thawl shQuld "nail down" in my #1? courses some of the 
student iPitcomes a little nlore specifically, especially in areas of applyin'g 



'^lik abstract' theory to practical problems. 
'■P It made writing objectives morf meaningful. I thought it would be cut 
•'and. dry but. we had a good two-hour discussion on writing them. 



I ^ ^ * • .. . . ... \ ^ . ' ^ ^ 

Mesa Verde / • 

The* coj^any was divine and the di n^ner- great.' I also like the materials 
tp' use as a resource'. ' " - 

Grossmont ^ ^ " ' ' 

I became aware of how nrany of " my frustrations are shared by others. 

...There was f rustr^^ition .at or tpv<aif*d the'end of this module. I'm not sure 
.if it Was caused by the group pr ^thei^module. / * 

I' got high for a minute". I lyiow what it's like how to work for the^^, 
state department. . ; • • ^ • ' 

I ♦ouncj^-^that I really 1 i ke *worj<jng* on stisatfgies. 

. Dr." Gysbers^ Class ^ '*^f'"^'^'^''- ' •ill 

I realized the* iitiportance of establ ishi ng avw implementing criteria" 
for selection of x)bjectfve process. " . ' ^. 

Mt occurred^ to me that it would be interesting to take each unit of a 
It* course- and r*eeval.uate the, teaching strategy 'used^Jbr-each unit, ^su^pect 
; I wauld make several changes. ^ . ' ' *^ - 

* ^ * , ■ 

Module .8 • ^ > 

: ¥^ * 



.Mesa Verde 



^at beginrmig^-got-4»^--of-f-oiv^h 



We spent a|j9t of time, going over things we al ready .knew and- yj«?cl if 
'I e^pecttjllj^ lifore career erd,* less, planning methodology. Kowe^i^> once I 
accepted th|t, it was OK.' t#:— ^ 

r enjoyed the group exchange. * , \ * ^^^^ ^ ' 

• ' ' ^ ■ . ■ '^^ ^ do^ -^^ ; ■ ■ , ' > . 



Digest 1, continued 
Item 8 



Grossmont 




I got to know a few people better; we rea 1 i zed|We ' re already knowledgeable. 
I found the Triple I and PERT theories rat;her iViterestinq. These were ' 
new to me» . "♦ 

It's much more complicated than I thought. 

I would like mor6 specific examples of hoVi/.aMv4:his is going to be carried 
out. ' ..■ ^ . ^ ^ 

- It'$ hard' to" k^ep focused _on the objective for the day. The activities 
are no't always, cleirly re^^ted to'the objectives'. 
■i, IC-*ittis a good. enviroDment, pleasant. 

Gysbers' Class , ' ^ " " ^ - * 

TOtim T feel like a Jtt of this is busy work. It almost seems like 
uld be so bogged down, in process and 'organizational maneuverinoAthat 
cotHd reach very- few goals. . " 

JhflilERT chart is. a system far superior to my "To Do'* lists. 
Confusing. 




Mesa Verde 



' After yesterday, I really didn't expect anything. ' . 

"^.1 Better than Y expected; I will read the module in detaW now. 
, gained practical information for a specific project/ . . - . 

Grossmont . ' v - 

' ' -f. ' 

The evaluation of abilities and interests (skills) as illustrated b| tj?e 
material was; Confusing. I am still not certain how one vwi/ld determinelBkill s • 
and ••abilities in a. rear si tuation other than in a subjective way. 

Skill at applying to pap^r wi|at I have already used. . 

Dr. GysbersMJ^ss 



I learrled the difference between setting up a career fair and helping ' 
the counselors learn hoW to ^lo this.. 

I was unaware of .the Targe artiount of sources of 'he! p and deMvery methods 
for S'taff development that are availabVe. " ' 
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t wasn't aware that I was already practicing many alpects af thlT module. • • 
'I feel Ih^ tieedsv should have been assessed before'having me si.t-*lTrtouqh - / 
previously covered material. I do- not- feel that the pr^rassessment" sheet was ' 
ad^quale." . ' • ' ■ >• ' - 



c ' ■ ■ . " ' Digest Ij eontinued - 

• ' ^ Item 8 ' 

' . ■' . . • ' ' 

" ' I realized I already knew many of the coopepts; .there was nbt enough 

specifics on how to > ^ , ' * 

Discussion with my coworkers. 

GrQSsmont * _ . . ' * , ' 

I became quite hostile during this experience; the .four other- modules I 
participated in left me quite positive. - * 
-^There are t6o many different terms. Be wore practical. 
Several pooped .and punchy counselors and .a very patient Coordinator. 

Dr. Gysbers' Class . 

Confusion. - ■ „ 

I believe that this module as- well as all of the others can be relevant^ 
in fields pther than carter guidance. 

Module n . , . : ' 

M^a Verde • ^ . ^ 

Fat;igue. ^ , ^ / 

I felt I wits forced to reword other concepts,! already knew. 

Tremendous> fatigue 'after teaching a fu^Tl days ^^t Pre n do.ing this. . . 

' ' '* * . ^ , ' • ^ . 

Grossmont . - . ' . 

I'm frustrated. ^ Much , of the matter herje is mandated--we do it "their" 
(the district's) way.» * . : , ' 

rm, somewhat uncomforta*bl e with the speed with which the* information 
was presented .^It was tao rapid in same areas. Nbt enough tim^ was alotted. 

Dr! Gysbers* Class . . • / - \ 

' I feel that J have the, proper rationale to make proper decisions based on 
^program evaluation with an ongoing program. - ^ ^ 

, Extreme boredom. • * 



Module 12 



Grossmont ^ . " . 

Tm positive. I see the value- of^he process . 

Some .frustration with some repetiPiveneSs in content.'^ 

Dr. -Gys*bers' Class . - v 

The materials show^how the stat courses T am noV enrolled in can* be 
interrelated and meaningful to my educational future. ♦ • 

^ > ' Some educational statistics became more clear wi th "practical '^uses. . 

1- 97 A.24 \ ^ . ' . T". 
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■■^ ' - / ' . ■ : ■ ^Digest- Ij coHbinued 

' ^ . , \Mem 9 

9\ . Do yihi haVQ any criticisms' of this fnodUle^ or suggestions for imprp\>ixig tt? ^ 




Jf *soj ^ed^e 'list your ideas ■ below : 



Module 3 



Grossmoht ^ ' ' . ^ ' > ^ 

A lot of material in a relatively short time.- j 
I needed fliore time to read and understand to getjthe most hejp' from this* 
Materials should.be read in advance. More> complete analysis pf activities 
relative to desired outcome^- should be made. . ' '\ • . ' 

When presenting these materials to 'experienced working peoplef, I feel' the 
material should be handed ^out aheald of time. Exercises should bef done and / 
presentations made to clarify and modify areas in question. ^ ;,i 

It was too lengthy. I'm. burnt out by the end of the day. - ^ - 
We should worbwith our own ^chool team. T|ie reading ^houldjbe done ^ • 
previous to the meeting. The coordinator- c6uTd.revievrhigh^'ight$ 5jid answer 
questions. ^ \/ ' \ t T > - * 



' Dr. Gysbers' Cla^s ^ _ « . ' — ^-^^ — — 

^ Excessively wordy. Most of the material could be reduced by one-half^ . 

and not lose any meaning. Cairtoons are yfeally stupid.* They insult my 
intelligence! If / ^ ' ^ • . " 

I thought the module was very infopiative^. . ^ . i 

This has been the most practipal module so far. Th£ activities were 
helpful in seeing how these, sampl ing niiethods real ly operate. ^ 

The "Critical Incident" and "belpfhi" techniques are 'unclea'r. 

Maybe ^a greater"emphasi$ .should placed on adap^ting an existihs survey 
instrument to the local situation. ;4f the entire guf^nce department* h^s^ 
very little background' in this ^reai^ it wou^d seem that\ the^ aidaptive technique 
might result in a better instrumeri^ / * \ * 

. i •'' ^ ' * 

M(5du1e 4- . . ' ' ' ' / > . , ; 

y^ 'Mesa Verde - ^ 

The^tirae spent and when the inservice was held. 
FTeasdTnable;. the objectivi ty-subjectivi^ was flaky^ 

• •• • %\ • " ^ • 
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^ . Digdet 2^ continued/ 

' Grossmont \/ ' ' - ~ 

There was too much reading on site. Spend mdre time on activities.' 
• - I need more time and helpl.!! / ' ^ ^ 

I need some change i'h the format for "assessing current resources.." It's 
■ tod far away from the 'information I have. .* . I - 

• I needed j a little more clarity on objectivity vs. subjecti^ty in 

• inventory gti^ms, . \ a 

The total^^i dance department sfioyld" have been involved in this module. 
I would reajly like the coordinators to relate bore of their expertise. 
feople ter^r to vent the same frustrations over and over. While this is 

• necessary, I am ,tired of hearing them all last spring and now. If all that 
energy was put intoJ'doingVwe wpuld be better off,' It's like arguing with • 
the referee at a football g^me, . It's, futile. 

Dr. Gysbers' Cli 

Exercises ar'e^boring and repeti tive."* - 

Excessively wordy, ' ^ >, • * 

Please give a clearer statement as to what is meant by Process-oriented 
and^rOtitcome-oriented statements. 
/Format for log, :se ems unnecessarily and impractically'-complicated. ^ 
^This is one of therfirst moduleswhich I felt had a lot of'new informat.toi^^ 
fnd techniques *that I could use. Mor6 clear and conci'se than past ^no^ul^. 

Spent ^tod much time analyzing the coun^ldr's logs--caused me Ho become ' 
disjnterestfed ^n n*t#purpo!^e. Should spend-more time covering the, difference . 
between outcome orieVitation and process ortenta^tion. 

— .1--": •■ , ; 



Module 5 



Mesa Verde 



^(No criticisms or suggestions were recorded from Mesa Ver.de in this module. ) 
Grossmont 



As in the others, 1 felt they were presented too slowly for most present, 
I ^joyed the* presentation of the coordinator.* 

It would have been more worthwhile to have all counselors from the same 
school in on, each phase. This would have been better for small group discussion; 
We got off into gripe sessions too much today. ' . 

Dr. Gysbers' Class . ' • ■ . ' 

They mentioned the AIR, model then explained" it, but when .they mentioned \ 
the Cal ifornia mocJel\ the explanatiorr was separated from it by another topic' 
This made it hard to follo(jp^^ , , 

The pestassessmen^s ar^ielpful because they'make, the reader actually , 
write down what, the module has said;. this helps commit i t \to mempry and stresses, 
the important points- of the module. ' ' . \ 
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Digieet 2j continued 
Item 9' 



Module 6 



Mesa llerde 



Seemed below the: level of Mager and otJwrs in the field. 

It stressed better evaluation tools/ but the activities were simplistic. 
• There should be-al ternati ves foMTeople who have a high degree of pro- 
ficiency in doing the things this program is designed to teach. 

After process and skill developttient, there is a- need to apply the skills 
to specific school problems. \ ■ ' ^ 



Grossmont 



J nip 



Emphasize mora practical wo/k. Add overhead transparencies, film strips, 
other teaching strategies to assist the instructor inJcQvering the modules. . 
Improve the vocabulary. for the sequencing categocjes to eliminate confusioru 
' ' ■ Giv6 example- first of ho^^ it should be done, pointing out components from 
that example. Thisn have eyferyone write thteir own objktive, and relate it 
/ to the example. A record /feviewing the day's learning at the end would help 

-^^ and a.4Copy for each participant would be great; . j 

4 personally reject /the notion that good counseling can baoiiantified. or 
/ (neasured in a real senik. I'd ;be fool ish to believe that such a system is, an 
accurate indication of/ the extent to which I have changed another human being 
Who. 'is to say if a„kiid who can now do seven out of 10 things has really learned, 
• " has real'ly. changed his life? . . . ^ ^ . i. .c- ' ' 

/ It seenis to movef slowly. Perhaps a 'fnore- directive styl6 with firm . 

. ■ examples might speed things up. I would rathenhear a guidance-related examp 
, than one for tennii players. ' . 

• Describe the difference between good and poor objectives in. greater de- 
' • tail. List many /examples and give a description of what makes the e)?ample- 

good or .poor. ■ /''' '"' ^ •- o 

Physica,1ly,/why not have sniall conference tables and comfortable Chairs? 
: ' ' Do a bettef job of ' relattiig the concepts "of awareness," accommodation, and 
•action to *the /state Master Plan and objective writing. I, felt the A.A.A. was 
thrown in" to /impress the state. ' ^ a. ^ ' 

I- need mdre ttme to assimilate;, the whole process seems^^too fast for me. 
" . The sem^tics of some exercises were vague and diff icuTt-. to think through. 

. "~ Or; Gysbers' Class ' . ' , . , ' . « • 

Wordy/ but 'very' .helpful 'Short and sweet would be better.- 
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Drawn-out, and ambiguous-. 

It would be better to ^ have a set of niodules.^of ones own. 
'a usefut learning device"." \'- ' " / , ■ . . ' . ^ . • 

I 14-ked thei sample ABCO; rtiethod; it fits well with my mode ofXhinking.. , 

Cartooiis lacked. - • v ' ' , . „' '■ /■,■, . a ' 

', I /thought that the section- "Producing Full Objectives" Was r^&Hy good... , • 
/ More explanation rieeds to be given to the difference bfttj^eefT student outcomes 
versys student behavioral objectives.' 'Is the distinction th*fe^important? 
/ Give one example of a perfonmance objective and elaborate from that. . 

Use of a stem sentence as mentiijbned in point 5 of thi s ,r|eaction form would, 
be One suggestion. . , ; ' . . - I 

' ' : V - J. A-27 ■ • • ' 



„/■•• 



100 



Digest ly aontinued 
Item 9 



Module 7 



Mesa Verde / 

It was too ambiguous; the questions don't seem appropriate. 

I felt it was podr irT its design/ Not really a viable learning instru- 
ment; evaluation f'orms are poor, questions do not a-lloW for reasonable dif- 
ferences. ^ 

Grossmor>t ' . > 

I felt it was too long. It could have been accomplished in a shorter 
time span. * ' 

Some of the vocabulary duplicated itself: decision making and performance 
objectives, for example. Stick to one term. / . 

.1 do not believe the time spent on each acti^^^ity was necessary. I think . 
it was simple enough to learn by simply reading/the module. 



Dr. Gysbers ' Class ^ 
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The Post-assessment is iimbiguous; it is jiard to understand what is/wanted. 
^ ^The "menu" activity while ^proving its point; seeris silly. 
Possi'bkjy add this to another module. There is nbt enoug.h information to 
t^ke up a whole module. ^ f 

I feel very cynical about this module because i did six and seven in one 
night. They get to be very repetitive. ' 
. - Give one complete example. of a student objecti v<jj^and all four steps that 
. .you must go through before coming up with your strategy. 

Our group. seems to be learning mdre in our group discussions of the 
material than we thought possible. / 
.1 think the summaries. of the publications might be made more comprehensive. 

> . . . ■ , > > " • 

Module 8 ^ 

~ ■ . . ' >^ , . / ■ 

" Mesa Verde * / ^ , . 

This type of manual is known to be the most difficult to read. It makes 
problems^ unnecessarily./' 

It's misleading to /call this "Career Guicfance." Even though the, i 1 1 ustra- 
tions are gufdance-oriented, the module appears to address itself to planning 
of any kind. • * 

. The modules . rely, .too heavily upon the facilitator;. The program is heavily 
guidance oriented;, teachers would fail to see relevance, 

Grossmont 

The informatior// is something I already know. The module simply presented, 
it in a format. 

Techniques" for//determining time for tasks would be' helpful 

^ " ^ A-28. 
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'It would be of much greater educational value: to utilize objective, pra^g- 
rtiatic, non-value-laden examples. 

Most of this could have been read ahead of time. Individual schools 
rshould then meet and plan together. I don't like taking time to play games 
when time is so precious ! ! 

Don't hold, two modules in the same room. It's hard to concentrate. 
' Some of the mat^Vial was not clear. More instructi on .was needed, or more 
directors in the activities. 



Dr. Gysbers" Class ' . ^ * 

Condense it. * ^ ■ ( y 

I could have, used porje instruction on how to develop time/task/talent 
charts and PERT networks. 

The exercises are unclear, . . 

'The concept of PERT rtfetl^arks was unclear, both ,in content and when to 
use it. " 

Drawings and illustrations of the PERT system need to be revamped for 
better understanding. ; * 

Please shorten. Perhaps eight and 9*could be put together in one module. 



Module 9 



Mesa Verde 



Dpn't call it "Career Guidance for Staff Devel opment^' ; it is misleading 
to at least my idea of career guidance. 

V Keep the same terminology as used in previous module. 



Gro^'Smont 



The .material was not as'well writte/n. / The models used were not as clear 
in (temonstrating the concepts. . j 

As with module eight, this could be a valuable' brush-up and revi.ew of 
skills; but it go^ to,o' slowly, is too time consuming and simplistic. 

Our group intfifratfion was poor. - 

Dr. Gysbers' Clasr - * . ! ; 

The. module was very ^.helpful and not too wordy. It could easily -be combined 
with eight, though. , ^ ♦ • > 

Consol idate several modul,es. ^ - . 

Combine this module with eight. ' ' ' 

The listing of agencies would be useful; except that we don't keep the 
TTiodjles- Perhaps these contact agencies could be listed on a tear-out sheet 
that the student could keep as a reference. 
_ Qonciense it. • ; 
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Module 10 



^> Mesa. Verde 



'More of an assessmeint of. our heeds and abilities was needed prior, to 
this workshop. The fatigue factor is critical. I started my sohbo,l{;day /V 
before 7 am. ^ 4 - * . .* 

Language or terms are in research liinguage'; they put people, off. 

Know your school, before subjecting staff -to your materialsl Much' of the^ 
material covered in this module is on file at this school and being iipplemented, 
for every three-week unit. / . " 

, Fewer worcte, ple^ise. / - — v 

It might be OK for a regular;high school. I suggest you assess the level 
of sophistication of tlje field test staff. before presenting a workshop.. 

Grossmont • 

The material was npn-essential , redundant, ad nauseum. 

Le^ve out many t^rms. fut it into more- pr^cti cal language for counselors. 

Activities and text took simplistic pj^ocessps and, applying 'ambiguous 
jargon, succee^ied. in making each. module thoroughly confusing. Activities 
needed examples to get things going/irt the rigljt dirisction. 

I feel th-e only way we can i^ally 'develop l!he skills ir) these modules- 
would be for .the ftoordinator to come to the l-Ocal school and worflc with e\eh 
counseling staf f/Jndi vidual ly. 



counseling starr/;nai viauai ly. i • r l ^ V-^ 

I wish th^tphe three modules 8,9* dnd TO could have beism cpy^eo in\?wo 

days With the tmj rd day being devoted to exercises where we dfH>l||p concepts 

from all three modules. • ^ ' - \ ' 

Keep it simple. Use the most simple term for better understJlY^tng-' | 

Dr.. Gjrsbers' Class * 

I felt a need for examples of (the four measurement techniques. 

Some act1v1t|ies seem irrelevant; better examples could be used. 

It needs to be said but not at such length. . " . 

Explain more' explicitly how a pilot stufly^^ff ers from .the actual 
ob^'ective; give more opportunity for practicin^how to use a pilot study to 
.its best advantage. . , 

I. would have found it useful to have an example of each of. the four basic 
monitoring techniques. ' ' . ^ / 

■ { 



Module 11 



Mesa Verde 



\ 



ERIC 



Make the activity real by applyin^g the skill to a program we are using. 
Give alternative definitions; use common terminology. 
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iHgcat J, eontiJiued 



Gros smart 



It wfeuld be helpful if I had h^d the previous modyles, so that there would 
be continuity. • " \ • * - , 

r It was tpo long foe a ofie-day session. The activities don't always give;' . 
enough information. 

Set a definite time schedule sd as to be sure to comp>ete all parts within 
a reasjonable time, / 

Allot, more time for' befcoming more familiar with the material. Could' t[.e 
-handbooks possibly be passed jout in advance of the meeting? 
* Take more -care in the examples. 

I needed morej^ime. Some pre-exposure would have helped. 

Dr. Gysbers' Cl^^s ' / , , ' 

I liked the summaries aFt the end o"f ^each of the sections. The other 
modules should have these also. . . 

It tarkes a cauple of readings to grasp the point of the module. The 
activities help a lot. I liked the short post-assessment 1 . 

Too detai led. ^ ^ * ^ 

Condense. 

The postassessment for this module did not require .a complete review of 
• .the module, but focused on a fajrly narrow range of the tota*1 material pre- 
\ sentey. 



Module 12 



Grossmopt ' J • ' 

J 

Allow more time. 

More time for practical work was neecjled.^ Select a local school program 
and critique it. 7 

In my opinion, the material could haVe'been covered in less time. 
. Work on a specific local problem in itbe exercises. Do this in groups. ' 
Get rid of the compound-comple^ sentences. "Deflate*' some of the pfiiri- 
/ graphs. • ^ , ^ 

In all modules^gr^oup participation and involvement of each activity should 
' take place, so participants can get' ir^tant feedback if activity's goal is 
^ being met. \ ' . X 

Make it mo>e concise. It was impossibj^ to complete it all in one day. 
It was the best written and organized of all the^dules I experienced. 



' Dr. Gysbers' Class . , • 

I felt that, for me, this module was highly unnecessary. Don't they qive 
us^credit fcfr krtewing anything • 

Cut down the postassessment or cu.t it out. . 

Too 'repetitive, in descriibi ng content, format, 'and level of sophistication. 
I feel that the "scoring system" thai the coordinator has for the 
Postassessment shou-ld be m£(de available in the module. ^ - 

\ • . -'-v 1.-. 
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